-- Logs begin at Thu 2022-10-13 10:30:02 UTC, end at Thu 2022-10-13 11:11:42 UTC. -- Oct 13 10:56:40.595686 dv-cinder-861001-1-iscsi systemd[1]: Starting Devstack devstack@keystone.service... Oct 13 10:56:40.604502 dv-cinder-861001-1-iscsi devstack@keystone.service[81524]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Oct 13 10:56:40.606604 dv-cinder-861001-1-iscsi devstack@keystone.service[81524]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Oct 13 10:56:40 2022] *** Oct 13 10:56:40.606604 dv-cinder-861001-1-iscsi devstack@keystone.service[81524]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Oct 13 10:56:40.606604 dv-cinder-861001-1-iscsi devstack@keystone.service[81524]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Oct 13 10:56:40.606604 dv-cinder-861001-1-iscsi devstack@keystone.service[81524]: nodename: dv-cinder-861001-1-iscsi Oct 13 10:56:40.606604 dv-cinder-861001-1-iscsi devstack@keystone.service[81524]: machine: x86_64 Oct 13 10:56:40.606604 dv-cinder-861001-1-iscsi devstack@keystone.service[81524]: clock source: unix Oct 13 10:56:40.606604 dv-cinder-861001-1-iscsi devstack@keystone.service[81524]: pcre jit disabled Oct 13 10:56:40.606604 dv-cinder-861001-1-iscsi devstack@keystone.service[81524]: detected number of CPU cores: 4 Oct 13 10:56:40.606604 dv-cinder-861001-1-iscsi devstack@keystone.service[81524]: current working directory: / Oct 13 10:56:40.606604 dv-cinder-861001-1-iscsi devstack@keystone.service[81524]: detected binary path: /usr/bin/uwsgi-core Oct 13 10:56:40.606604 dv-cinder-861001-1-iscsi devstack@keystone.service[81524]: your processes number limit is 47680 Oct 13 10:56:40.606604 dv-cinder-861001-1-iscsi devstack@keystone.service[81524]: your memory page size is 4096 bytes Oct 13 10:56:40.606604 dv-cinder-861001-1-iscsi devstack@keystone.service[81524]: detected max file descriptor number: 2048 Oct 13 10:56:40.606604 dv-cinder-861001-1-iscsi devstack@keystone.service[81524]: lock engine: pthread robust mutexes Oct 13 10:56:40.607388 dv-cinder-861001-1-iscsi devstack@keystone.service[81524]: thunder lock: enabled Oct 13 10:56:40.607388 dv-cinder-861001-1-iscsi devstack@keystone.service[81524]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Oct 13 10:56:40.607388 dv-cinder-861001-1-iscsi devstack@keystone.service[81524]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Oct 13 10:56:40.647306 dv-cinder-861001-1-iscsi devstack@keystone.service[81524]: Python main interpreter initialized at 0x5644ae4739c0 Oct 13 10:56:40.647306 dv-cinder-861001-1-iscsi devstack@keystone.service[81524]: python threads support enabled Oct 13 10:56:40.647306 dv-cinder-861001-1-iscsi devstack@keystone.service[81524]: your server socket listen backlog is limited to 100 connections Oct 13 10:56:40.647306 dv-cinder-861001-1-iscsi devstack@keystone.service[81524]: your mercy for graceful operations on workers is 90 seconds Oct 13 10:56:40.647640 dv-cinder-861001-1-iscsi devstack@keystone.service[81524]: mapped 403077 bytes (393 KB) for 2 cores Oct 13 10:56:40.647732 dv-cinder-861001-1-iscsi devstack@keystone.service[81524]: *** Operational MODE: preforking *** Oct 13 10:56:40.647971 dv-cinder-861001-1-iscsi devstack@keystone.service[81524]: *** uWSGI is running in multiple interpreter mode *** Oct 13 10:56:40.647971 dv-cinder-861001-1-iscsi devstack@keystone.service[81524]: spawned uWSGI master process (pid: 81524) Oct 13 10:56:40.648169 dv-cinder-861001-1-iscsi systemd[1]: Started Devstack devstack@keystone.service. Oct 13 10:56:40.649645 dv-cinder-861001-1-iscsi devstack@keystone.service[81524]: spawned uWSGI worker 1 (pid: 81533, cores: 1) Oct 13 10:56:40.649645 dv-cinder-861001-1-iscsi devstack@keystone.service[81524]: spawned uWSGI worker 2 (pid: 81534, cores: 1) Oct 13 10:56:40.649645 dv-cinder-861001-1-iscsi devstack@keystone.service[81524]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Oct 13 10:56:45.010597 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 13 10:56:45.010597 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: from cryptography.utils import int_from_bytes Oct 13 10:56:45.011417 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 13 10:56:45.011417 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: from cryptography.utils import int_from_bytes Oct 13 10:56:45.011577 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 13 10:56:45.011577 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: from cryptography.utils import int_from_bytes Oct 13 10:56:45.012026 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 13 10:56:45.012026 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: from cryptography.utils import int_from_bytes Oct 13 10:56:45.062048 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 13 10:56:45.062245 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 13 10:56:45.062438 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG uwsgi [-] command line args: [] {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 13 10:56:45.062710 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 13 10:56:45.062891 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG uwsgi [-] ================================================================================ {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 13 10:56:45.063151 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG uwsgi [-] admin_token = **** {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 10:56:45.063237 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 13 10:56:45.063406 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG uwsgi [-] config_dir = [] {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 10:56:45.063494 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 13 10:56:45.063600 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 10:56:45.063743 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG uwsgi [-] command line args: [] {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 13 10:56:45.063830 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG uwsgi [-] config_source = [] {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 10:56:45.063951 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG uwsgi [-] debug = True {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 10:56:45.064127 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 13 10:56:45.064208 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 10:56:45.064454 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG uwsgi [-] ================================================================================ {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 13 10:56:45.064559 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 10:56:45.064666 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 10:56:45.064769 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG uwsgi [-] admin_token = **** {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 10:56:45.064914 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 10:56:45.065058 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG uwsgi [-] config_dir = [] {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 10:56:45.065179 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 10:56:45.065322 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 10:56:45.065441 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG uwsgi [-] list_limit = None {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 10:56:45.065577 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG uwsgi [-] log_config_append = None {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 10:56:45.065689 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG uwsgi [-] config_source = [] {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 10:56:45.065793 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 10:56:45.065897 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG uwsgi [-] debug = True {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 10:56:45.066007 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG uwsgi [-] log_dir = None {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 10:56:45.066113 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG uwsgi [-] log_file = None {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 10:56:45.066224 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 10:56:45.066354 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 10:56:45.066507 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 10:56:45.066585 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 10:56:45.066703 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 10:56:45.066828 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 10:56:45.066950 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 10:56:45.067073 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 10:56:45.067195 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 10:56:45.067321 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 10:56:45.067321 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 10:56:45.067551 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG uwsgi [-] list_limit = None {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 10:56:45.067551 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG uwsgi [-] log_config_append = None {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 10:56:45.067764 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 10:56:45.067887 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 10:56:45.068011 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 10:56:45.068142 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG uwsgi [-] log_dir = None {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 10:56:45.068265 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 10:56:45.068382 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG uwsgi [-] log_file = None {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 10:56:45.068504 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 10:56:45.068641 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 10:56:45.068768 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 10:56:45.068875 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 10:56:45.068995 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 10:56:45.069152 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 10:56:45.069275 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 10:56:45.069394 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 10:56:45.069522 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 10:56:45.069645 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 10:56:45.069645 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 10:56:45.069865 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 10:56:45.069987 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 10:56:45.069987 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 10:56:45.070216 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.18/identity {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 10:56:45.070331 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 10:56:45.070458 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG uwsgi [-] publish_errors = False {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 10:56:45.070582 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 10:56:45.070706 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 10:56:45.070829 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 10:56:45.070945 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 10:56:45.070945 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 10:56:45.071169 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 10:56:45.071291 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 10:56:45.071418 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 10:56:45.071537 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 10:56:45.071652 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 10:56:45.071773 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG uwsgi [-] standard_threads = False {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 10:56:45.071889 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 10:56:45.072018 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 10:56:45.072018 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 10:56:45.072251 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.18/identity {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 10:56:45.072385 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 10:56:45.072511 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG uwsgi [-] publish_errors = False {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 10:56:45.072629 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG uwsgi [-] use_journal = False {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 10:56:45.072745 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 10:56:45.072860 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG uwsgi [-] use_json = False {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 10:56:45.072860 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG uwsgi [-] use_stderr = False {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 10:56:45.073105 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 10:56:45.073235 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG uwsgi [-] use_syslog = False {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 10:56:45.073359 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 10:56:45.073475 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 10:56:45.073597 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 10:56:45.073597 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 10:56:45.073891 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.074012 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG uwsgi [-] standard_threads = False {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 10:56:45.074128 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.074245 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 10:56:45.074361 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.074477 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 10:56:45.074601 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.074720 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 10:56:45.074836 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.074952 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG uwsgi [-] use_journal = False {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 10:56:45.075068 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.075183 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG uwsgi [-] use_json = False {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 10:56:45.075183 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG uwsgi [-] use_stderr = False {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 10:56:45.075420 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.075537 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG uwsgi [-] use_syslog = False {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 10:56:45.075653 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.076367 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 10:56:45.076485 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.076610 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.076729 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.076847 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.076969 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.077104 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.077233 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.077362 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.077488 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.077605 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.077721 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.077838 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.077954 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.078082 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.078200 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.078200 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.078425 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.078541 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.078657 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.078657 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.078918 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.078918 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.079143 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.079259 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.079383 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.079383 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.079616 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.079732 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.079853 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.079971 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.080159 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.080278 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.080402 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.080519 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.080635 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.080635 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.080868 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.080986 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.081145 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.081262 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.081390 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.081508 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.081636 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.081753 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.081870 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.081995 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.082114 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.082230 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.082353 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.082471 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.082587 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.082704 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.082819 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.082934 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.083058 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.083178 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.083301 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.083418 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.083534 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.083649 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.083773 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.083896 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.084013 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.084129 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.084245 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.084367 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.084492 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.084610 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.084726 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.084841 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.084957 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.085088 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.085219 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.085337 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.085453 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.085569 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.085685 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.085800 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.085996 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.086121 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.086239 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.086355 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.086470 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.086586 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.086710 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.086827 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.086944 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.087059 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.087174 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.087291 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.087415 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.087532 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.087648 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.087763 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.087879 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.088003 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.088104 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.088201 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.088304 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.088404 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.088501 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.088606 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.088704 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.088801 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.088898 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.089079 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.089213 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.089340 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.089463 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.089589 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.089715 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.089823 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.089939 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.090064 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.090182 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.090289 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.090393 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.090516 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.090641 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.090767 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.090889 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.091018 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.091136 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.091243 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.091411 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.091566 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.091692 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.091821 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.091957 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.092075 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.092192 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.092298 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.092408 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.092538 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.092663 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.092770 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.092881 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.092997 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.092997 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.093247 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.093247 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.093461 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.093579 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.093696 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.093812 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.093936 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.094055 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.094171 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.094294 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.094412 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.094534 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.094661 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.094785 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.094903 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.095019 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.095135 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.095252 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.095377 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.095495 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.095613 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.095730 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.095848 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.095971 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.096098 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.096215 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.096332 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.096449 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.096565 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.096680 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.096812 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.096937 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.097101 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.097223 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.097339 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.097456 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.097649 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.097778 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.097902 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.098020 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.098137 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.098263 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.098390 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.098516 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.098635 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.098760 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.098879 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.098996 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.099114 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.099242 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.099361 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.099479 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.099596 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.099713 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.099838 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.099970 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.100095 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.100214 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.100331 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG uwsgi [-] auth.external = None {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.100448 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.100566 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.100694 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.100814 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.100933 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.101065 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.101184 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.101332 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG uwsgi [-] auth.password = None {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.101461 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.101581 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG uwsgi [-] auth.token = None {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.101707 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.101838 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.101838 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.102071 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.102189 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.102308 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.102434 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.102555 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.102673 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.102791 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG uwsgi [-] auth.external = None {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.102909 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.103028 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.103155 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.103274 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.103400 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG uwsgi [-] credential.caching = True {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.103526 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.103903 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.104026 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG uwsgi [-] auth.password = None {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.104154 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.104274 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG uwsgi [-] auth.token = None {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.104392 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.104510 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.104639 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.104759 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.104886 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.105064 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.105187 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.105305 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.105423 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.105554 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.105683 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.105803 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.105921 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.106040 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.106165 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.106284 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG uwsgi [-] credential.caching = True {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.106410 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.106529 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.106648 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.106766 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.106884 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.107027 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.107161 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.107283 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.107402 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.107527 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.107646 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG uwsgi [-] federation.caching = True {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.107772 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.107892 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.108011 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.108129 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.108248 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.108367 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.108494 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.108614 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.108732 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.108850 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.108969 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.109098 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.109229 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.109350 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.109469 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.109588 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.109712 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.109831 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.109958 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.110078 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.110197 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG uwsgi [-] federation.caching = True {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.110314 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.110433 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.110550 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG uwsgi [-] identity.caching = True {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.110676 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.110795 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.110914 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.111032 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.111150 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.111268 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.111396 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.111526 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.111645 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.111765 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.111884 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.112002 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.112197 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.112324 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.112445 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.112564 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.112682 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.112811 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.112940 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.113075 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.113196 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG uwsgi [-] identity.caching = True {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.113314 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.113432 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.113551 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.113681 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.113802 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.113921 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.114039 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.114157 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.114275 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.114401 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.114521 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.114641 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.114759 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.114877 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.115009 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.115138 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.115258 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.115377 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.115496 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.115620 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.115739 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.115869 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.115989 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.116108 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.116225 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.116350 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.116469 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.116595 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.116715 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.116833 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.116951 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.116951 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.117250 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.117381 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.117502 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.117620 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.117739 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.117857 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.117984 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.118104 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.118222 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.118340 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.118458 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.118575 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.118701 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.118828 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.118947 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.119071 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.119180 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.119297 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.119423 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.119543 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.119661 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.119780 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.119898 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.120017 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.120142 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.120261 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.120379 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.120379 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.120600 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.120718 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.120845 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.120973 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.121113 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.121232 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.121350 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.121468 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.121598 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.121723 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.121841 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.121961 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.122078 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.122196 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.122321 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.122441 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.123063 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.123183 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.123301 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.123418 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.123544 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG uwsgi [-] ldap.user = None {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.123544 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.123766 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.123884 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.124003 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.124127 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.124254 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.124373 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.124490 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.124608 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.124725 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.124842 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.124967 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.125106 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.125224 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.125342 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.125459 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.125576 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.125705 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.125826 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.125944 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.126062 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.126180 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG uwsgi [-] ldap.user = None {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.126297 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.126297 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.126528 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.126646 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.126763 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.126881 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.126998 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.127124 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.127244 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.127361 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.127479 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.127596 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.127714 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.127839 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.127959 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.128076 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.128194 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.128311 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.128428 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.128554 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.128674 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.128791 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.128910 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.129081 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.129204 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.129334 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.129461 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.129580 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.129698 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.129815 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.129933 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.130059 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.130184 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.130304 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.130422 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.130539 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.130656 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.130785 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.130905 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.131024 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.131141 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.131259 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.131378 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.131504 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.131624 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.131744 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.131863 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.131980 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.132098 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.132224 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG uwsgi [-] resource.caching = True {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.132343 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.132461 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.132580 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.132697 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.132823 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.132943 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.133073 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.133193 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.133311 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.133430 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.133808 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.133929 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.134047 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.134164 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.134282 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.134400 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.134528 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.134647 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.134765 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.134883 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG uwsgi [-] role.caching = True {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.135000 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.135118 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG uwsgi [-] role.driver = sql {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.135244 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.135363 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.135481 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG uwsgi [-] resource.caching = True {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.135600 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.135718 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.135836 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.136030 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.136152 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.136271 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.136389 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.136507 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.136626 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.136753 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.136873 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.136991 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.137131 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.137249 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.137367 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.137497 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.137618 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.137737 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.137854 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.137972 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG uwsgi [-] role.caching = True {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.138090 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.138851 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG uwsgi [-] role.driver = sql {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.138979 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.139100 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.139218 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.139325 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.139443 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.139570 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.139692 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.139811 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.139929 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.140048 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.140166 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.140293 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.140413 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.140531 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.140649 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.140769 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.140893 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.141041 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.141163 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.141282 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.141399 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.141517 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.141647 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.141772 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.141893 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.142012 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.142130 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.142130 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.142360 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.142480 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.142599 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.142717 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.142835 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.142952 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.143078 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.143198 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.143198 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.143421 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.143538 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.143656 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.143781 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG uwsgi [-] token.caching = True {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.143902 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.144020 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.144138 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.144255 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.144374 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.144504 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.144625 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.144743 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.144861 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.144981 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.145118 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.145250 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.145371 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.145489 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.145607 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.145725 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.145842 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.145969 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.146089 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.146208 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.146326 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.146444 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.146562 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.146688 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.146808 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.146926 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.147045 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.147163 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.147280 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG uwsgi [-] token.caching = True {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.147407 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.147535 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.147663 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.147783 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.147900 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.148018 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.148137 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG uwsgi [-] database.connection = **** {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.148264 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.148384 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.148502 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.148619 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.148738 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.148855 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.148981 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.149118 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.149238 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.149373 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.149497 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.149616 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.149742 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.149862 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.149980 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.150097 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.150216 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.150333 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.150459 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.150578 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.150696 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.150813 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.150931 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.151057 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.151184 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.151295 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.151428 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.151548 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.151667 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG uwsgi [-] database.connection = **** {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.151788 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.151914 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.152033 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.152159 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.152280 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.152398 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.152515 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.152515 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 13 10:56:45.152745 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.152745 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.152745 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.152745 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.152745 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.152745 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.152745 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.152745 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.152745 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.153789 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.153789 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.153789 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.153789 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.153789 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.153789 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 10:56:45.153789 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 13 10:56:45.178415 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81533) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 13 10:56:45.178646 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81533) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 13 10:56:45.178872 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81533) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 13 10:56:45.180885 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81534) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 13 10:56:45.181155 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81534) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 13 10:56:45.181388 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81534) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 13 10:56:45.187721 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81533) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 13 10:56:45.190258 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81534) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 13 10:56:45.215868 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81533) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 13 10:56:45.216098 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81533) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 13 10:56:45.216765 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81534) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 13 10:56:45.216996 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81534) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 13 10:56:45.270107 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81533) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 13 10:56:45.270716 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81534) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 13 10:56:45.319486 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81533) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 13 10:56:45.319714 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81533) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 13 10:56:45.325191 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81534) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 13 10:56:45.325436 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81534) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 13 10:56:45.475982 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81533) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 13 10:56:45.476209 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81533) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 13 10:56:45.476370 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81534) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 13 10:56:45.476460 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81533) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 13 10:56:45.476608 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81534) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 13 10:56:45.476718 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81533) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 13 10:56:45.476834 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81534) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 13 10:56:45.476918 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81533) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 13 10:56:45.477069 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81533) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 13 10:56:45.477154 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81534) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 13 10:56:45.477297 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81534) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 13 10:56:45.477516 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81534) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 13 10:56:45.500565 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81533) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 13 10:56:45.500824 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81533) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 13 10:56:45.500912 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81534) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 13 10:56:45.501086 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81533) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 13 10:56:45.501172 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81534) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 13 10:56:45.501313 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81533) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 13 10:56:45.501396 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81534) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 13 10:56:45.501536 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81534) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 13 10:56:45.501618 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81533) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 13 10:56:45.501749 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81533) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 13 10:56:45.501832 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81534) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 13 10:56:45.501962 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81533) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 13 10:56:45.502046 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81534) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 13 10:56:45.502176 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81534) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 13 10:56:45.513872 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81533) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 13 10:56:45.514232 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81534) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 13 10:56:45.526534 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81533) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 13 10:56:45.526721 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81533) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 13 10:56:45.526947 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81533) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 13 10:56:45.527044 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81534) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 13 10:56:45.527172 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81533) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 13 10:56:45.527257 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81534) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 13 10:56:45.527390 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81533) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 13 10:56:45.527473 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81534) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 13 10:56:45.527603 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81533) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 13 10:56:45.527695 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81534) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 13 10:56:45.527815 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81533) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 13 10:56:45.527899 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81534) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 13 10:56:45.528034 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81534) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 13 10:56:45.528255 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81534) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 13 10:56:45.545145 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81533) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 10:56:45.545353 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81533) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Oct 13 10:56:45.545703 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81533) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 10:56:45.545823 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81534) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 10:56:45.545897 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81533) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Oct 13 10:56:45.545984 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81534) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Oct 13 10:56:45.546162 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81533) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 10:56:45.546319 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81534) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 10:56:45.546405 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81533) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 10:56:45.546524 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81534) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Oct 13 10:56:45.546667 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81533) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 10:56:45.546806 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81534) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 10:56:45.546924 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81533) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 10:56:45.547073 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81534) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 10:56:45.547337 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81534) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 10:56:45.547603 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81534) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 10:56:45.556578 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81533) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 10:56:45.556857 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81533) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 10:56:45.557154 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81533) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 10:56:45.557346 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81534) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 10:56:45.557436 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81533) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 10:56:45.557635 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81534) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 10:56:45.557901 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81534) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 10:56:45.558191 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81534) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 10:56:45.564444 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81533) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 13 10:56:45.565347 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81534) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 13 10:56:45.567354 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81533) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 13 10:56:45.567642 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81533) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 10:56:45.567928 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81533) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 10:56:45.568214 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81533) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 10:56:45.568296 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81534) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 13 10:56:45.568498 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81533) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 10:56:45.568591 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81534) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 10:56:45.568759 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81533) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 10:56:45.568842 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81534) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 10:56:45.569050 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81533) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 10:56:45.569137 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81534) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 10:56:45.569331 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81533) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 10:56:45.569427 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81534) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 10:56:45.569605 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81533) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 10:56:45.569690 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81534) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 10:56:45.569879 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81533) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 10:56:45.569962 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81534) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 10:56:45.570149 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81533) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 10:56:45.570233 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81534) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 10:56:45.570421 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81534) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 10:56:45.570699 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81534) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 10:56:45.570971 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81534) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 10:56:45.593585 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81533) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 10:56:45.594466 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81534) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 10:56:45.595055 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81533) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 13 10:56:45.595342 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81533) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 10:56:45.595945 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81534) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 13 10:56:45.596234 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81534) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 10:56:45.600012 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81533) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 13 10:56:45.600300 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81533) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 10:56:45.600591 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81533) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 10:56:45.600948 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81534) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 13 10:56:45.601263 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81534) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 10:56:45.601552 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81534) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 10:56:45.607029 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81533) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 13 10:56:45.607318 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81533) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 10:56:45.608191 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81534) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 13 10:56:45.608483 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81534) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 10:56:45.612969 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81533) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 13 10:56:45.613287 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81533) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 10:56:45.613573 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81533) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 10:56:45.613855 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81533) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 10:56:45.614131 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81533) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 10:56:45.614214 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81534) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 13 10:56:45.614409 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81533) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 10:56:45.614494 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81534) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 10:56:45.614682 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81533) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 10:56:45.614766 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81534) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 10:56:45.614950 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81533) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 10:56:45.615042 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81534) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 10:56:45.615317 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81534) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 10:56:45.615596 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81534) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 10:56:45.615870 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81534) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 10:56:45.616142 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81534) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 10:56:45.630943 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81533) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 10:56:45.631223 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81533) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 10:56:45.632200 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81534) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 10:56:45.632489 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81534) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 10:56:45.635357 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81533) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 13 10:56:45.636644 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81534) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 13 10:56:45.638849 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81533) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 10:56:45.639148 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81533) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 10:56:45.640043 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81534) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 10:56:45.640344 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81534) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 10:56:45.643400 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81533) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 13 10:56:45.644614 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81534) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 13 10:56:45.646550 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81533) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 13 10:56:45.647765 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81534) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 13 10:56:45.649856 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81533) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 10:56:45.650159 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81533) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 10:56:45.650446 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81533) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 10:56:45.650731 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81533) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 10:56:45.651024 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81533) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 10:56:45.651192 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81534) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 10:56:45.651316 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81533) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 10:56:45.651493 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81534) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 10:56:45.651784 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81534) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 10:56:45.652077 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81534) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 10:56:45.652384 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81534) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 10:56:45.652670 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81534) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 10:56:45.667790 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81533) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 13 10:56:45.668078 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81533) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 10:56:45.668343 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81533) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 10:56:45.668607 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81533) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 10:56:45.669040 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81534) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 13 10:56:45.669380 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81534) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 10:56:45.669660 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81534) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 10:56:45.669929 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81534) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 10:56:45.675730 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=81533) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 10:56:45.676830 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=81534) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 10:56:45.677300 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81533) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 10:56:45.678415 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81534) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 10:56:45.678830 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81533) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 10:56:45.679106 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81533) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 10:56:45.679952 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81534) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 10:56:45.680233 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81534) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 10:56:45.681968 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81533) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 13 10:56:45.682257 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81533) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 10:56:45.682540 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81533) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 10:56:45.682823 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81533) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 10:56:45.683047 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81534) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 13 10:56:45.683220 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81533) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 10:56:45.683337 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81534) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 10:56:45.683623 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81534) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 10:56:45.683911 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81534) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 10:56:45.684314 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81534) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 10:56:45.695341 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81533) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 13 10:56:45.695636 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81533) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 10:56:45.695923 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81533) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 10:56:45.696006 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81534) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 13 10:56:45.696209 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81533) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 10:56:45.696300 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81534) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 10:56:45.696548 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81534) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 10:56:45.696632 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81533) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 10:56:45.696833 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81534) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 10:56:45.696917 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81533) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 10:56:45.697154 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81533) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 10:56:45.697252 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81534) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 10:56:45.697519 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81534) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 10:56:45.697812 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81534) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 10:56:45.712571 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81533) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 13 10:56:45.713496 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81534) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 13 10:56:45.715510 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81533) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 13 10:56:45.717111 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81534) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 13 10:56:45.719157 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81533) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 10:56:45.720053 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81534) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 10:56:45.720607 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81533) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 10:56:45.721528 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81534) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 10:56:45.722104 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81533) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 13 10:56:45.722389 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81533) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 10:56:45.722798 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81533) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 10:56:45.723130 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81534) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 13 10:56:45.723416 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81534) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 10:56:45.723827 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81534) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 10:56:45.729198 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81533) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 10:56:45.730272 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81534) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 10:56:45.730664 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81533) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 13 10:56:45.731748 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81534) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 13 10:56:45.734332 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81533) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 10:56:45.734733 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81533) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 10:56:45.735021 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81533) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 10:56:45.735241 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81534) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 10:56:45.735328 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81533) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 10:56:45.735646 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81534) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 10:56:45.735937 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81534) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 10:56:45.736220 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81534) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 10:56:45.743070 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81533) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 13 10:56:45.743365 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81533) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 10:56:45.743654 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81533) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 10:56:45.744067 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81534) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 13 10:56:45.744366 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81534) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 10:56:45.744661 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81534) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 10:56:45.750558 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81533) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 13 10:56:45.750846 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81533) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 10:56:45.751146 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81533) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 10:56:45.751404 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81533) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 10:56:45.751687 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81533) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 10:56:45.751855 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81534) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 13 10:56:45.751958 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81533) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 10:56:45.752147 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81534) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 10:56:45.752231 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81533) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 10:56:45.752432 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81534) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 10:56:45.752514 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81533) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 10:56:45.752712 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81534) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 10:56:45.752803 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81533) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 10:56:45.752992 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81534) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 10:56:45.753162 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81533) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 10:56:45.753301 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81534) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 10:56:45.753392 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81533) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 10:56:45.753585 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81534) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 10:56:45.753667 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81533) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 10:56:45.753864 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81534) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 10:56:45.754058 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81533) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 10:56:45.754188 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81534) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 10:56:45.754370 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81533) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 10:56:45.754453 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81534) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 10:56:45.754686 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81534) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 10:56:45.754951 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81534) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 10:56:45.755228 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81534) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 10:56:45.755592 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81534) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 13 10:56:45.789400 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x5644ae4739c0 pid: 81533 (default app) Oct 13 10:56:45.790556 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x5644ae4739c0 pid: 81534 (default app) Oct 13 10:56:45.792611 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf5f069-b220-4b7e-a8eb-155e67087533 None None] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:56:45.792896 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf5f069-b220-4b7e-a8eb-155e67087533 None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:56:45.793199 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf5f069-b220-4b7e-a8eb-155e67087533 None None] PATH_INFO: `/v3` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:56:45.798173 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 1/1] 10.222.0.18 () {50 vars in 791 bytes} [Thu Oct 13 10:56:45 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 10:56:52.582278 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c746da82-2ea6-47db-8d0e-c94f9223b80c None None] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:56:52.582795 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c746da82-2ea6-47db-8d0e-c94f9223b80c None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:56:52.582795 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c746da82-2ea6-47db-8d0e-c94f9223b80c None None] PATH_INFO: `/` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:56:52.587038 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1/2] 10.222.0.18 () {54 vars in 927 bytes} [Thu Oct 13 10:56:52 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 13 10:56:52.592934 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f8466e-bb32-4cb6-9f10-5325f6b72fa6 None None] REQUEST_METHOD: `POST` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:56:52.593530 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f8466e-bb32-4cb6-9f10-5325f6b72fa6 None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:56:52.593530 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f8466e-bb32-4cb6-9f10-5325f6b72fa6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:56:52.665251 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: INFO dbcounter [None req-c2f8466e-bb32-4cb6-9f10-5325f6b72fa6 None None] Registered counter for database keystone Oct 13 10:56:52.685061 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG oslo_db.sqlalchemy.engines [None req-c2f8466e-bb32-4cb6-9f10-5325f6b72fa6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81533) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 13 10:56:52.691417 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writer thread running {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 13 10:56:52.871182 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG passlib.handlers.bcrypt [None req-c2f8466e-bb32-4cb6-9f10-5325f6b72fa6 None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=81533) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Oct 13 10:56:52.871489 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG passlib.handlers.bcrypt [None req-c2f8466e-bb32-4cb6-9f10-5325f6b72fa6 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81533) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Oct 13 10:56:52.929590 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.auth.core [None req-c2f8466e-bb32-4cb6-9f10-5325f6b72fa6 None None] MFA Rules not processed for user `8ba31ade43694cf8bf28f7528a9ea179`. Rule list: `[]` (Enabled: `True`). {{(pid=81533) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 10:56:52.931202 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-c2f8466e-bb32-4cb6-9f10-5325f6b72fa6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 10:56:53.058512 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 2/3] 10.222.0.18 () {58 vars in 1024 bytes} [Thu Oct 13 10:56:52 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 467 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Oct 13 10:56:53.353677 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c746da82-2ea6-47db-8d0e-c94f9223b80c None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:56:53.425446 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: INFO dbcounter [None req-c746da82-2ea6-47db-8d0e-c94f9223b80c None None] Registered counter for database keystone Oct 13 10:56:53.446604 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG oslo_db.sqlalchemy.engines [None req-c746da82-2ea6-47db-8d0e-c94f9223b80c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81534) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 13 10:56:53.453364 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writer thread running {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 13 10:56:53.570508 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c746da82-2ea6-47db-8d0e-c94f9223b80c None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:56:53.574758 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b0e461-0488-4338-a45c-26eb7efcd5df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ce4ee85562d450a9dc2f16f581130d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:56:53.575917 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b0e461-0488-4338-a45c-26eb7efcd5df admin admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:56:53.576196 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b0e461-0488-4338-a45c-26eb7efcd5df admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:56:53.576469 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b0e461-0488-4338-a45c-26eb7efcd5df admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:56:53.584561 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b0e461-0488-4338-a45c-26eb7efcd5df admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:56:53.636307 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: WARNING keystone.common.rbac_enforcer.enforcer [None req-e4b0e461-0488-4338-a45c-26eb7efcd5df admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Oct 13 10:56:53.636592 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b0e461-0488-4338-a45c-26eb7efcd5df admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:56:53.646441 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 2/4] 10.222.0.18 () {58 vars in 1324 bytes} [Thu Oct 13 10:56:53 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Oct 13 10:56:53.652620 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f8466e-bb32-4cb6-9f10-5325f6b72fa6 None None] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:56:53.670967 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f8466e-bb32-4cb6-9f10-5325f6b72fa6 None None] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:56:53.675335 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3628e2e4-7a76-4157-a971-8beb0b74cc81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ce4ee85562d450a9dc2f16f581130d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:56:53.676420 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3628e2e4-7a76-4157-a971-8beb0b74cc81 admin admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:56:53.676700 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3628e2e4-7a76-4157-a971-8beb0b74cc81 admin admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:56:53.676972 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3628e2e4-7a76-4157-a971-8beb0b74cc81 admin admin] PATH_INFO: `/v3/projects/9ce4ee85562d450a9dc2f16f581130d9` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:56:53.678553 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3628e2e4-7a76-4157-a971-8beb0b74cc81 admin admin] RBAC: Authorizing `identity:get_project(project_id=9ce4ee85562d450a9dc2f16f581130d9)` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:56:53.733914 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: WARNING keystone.common.rbac_enforcer.enforcer [None req-3628e2e4-7a76-4157-a971-8beb0b74cc81 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Oct 13 10:56:53.734260 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3628e2e4-7a76-4157-a971-8beb0b74cc81 admin admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:56:53.738904 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 3/5] 10.222.0.18 () {56 vars in 1207 bytes} [Thu Oct 13 10:56:53 2022] GET /identity/v3/projects/9ce4ee85562d450a9dc2f16f581130d9 => generated 344 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 10:56:55.854651 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01001d5-a6bc-4915-bb1b-59b05d1a5cdd None None] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:56:55.855188 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01001d5-a6bc-4915-bb1b-59b05d1a5cdd None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:56:55.855188 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01001d5-a6bc-4915-bb1b-59b05d1a5cdd None None] PATH_INFO: `/` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:56:55.860103 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 3/6] 10.222.0.18 () {54 vars in 927 bytes} [Thu Oct 13 10:56:55 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 13 10:56:55.865514 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579536a3-8754-4aa3-a65b-40578b67e268 None None] REQUEST_METHOD: `POST` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:56:55.865890 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579536a3-8754-4aa3-a65b-40578b67e268 None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:56:55.866052 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579536a3-8754-4aa3-a65b-40578b67e268 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:56:55.886764 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.auth.core [None req-579536a3-8754-4aa3-a65b-40578b67e268 None None] MFA Rules not processed for user `8ba31ade43694cf8bf28f7528a9ea179`. Rule list: `[]` (Enabled: `True`). {{(pid=81533) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 10:56:55.888249 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-579536a3-8754-4aa3-a65b-40578b67e268 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 10:56:55.895956 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 4/7] 10.222.0.18 () {58 vars in 1024 bytes} [Thu Oct 13 10:56:55 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Oct 13 10:56:56.164526 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01001d5-a6bc-4915-bb1b-59b05d1a5cdd None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:56:56.177181 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01001d5-a6bc-4915-bb1b-59b05d1a5cdd None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:56:56.181367 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e96420-746b-4dfa-bfe8-eb0eb28c07d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ce4ee85562d450a9dc2f16f581130d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:56:56.181961 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e96420-746b-4dfa-bfe8-eb0eb28c07d8 admin admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:56:56.182242 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e96420-746b-4dfa-bfe8-eb0eb28c07d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:56:56.182518 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e96420-746b-4dfa-bfe8-eb0eb28c07d8 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:56:56.190085 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e96420-746b-4dfa-bfe8-eb0eb28c07d8 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:56:56.191839 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e96420-746b-4dfa-bfe8-eb0eb28c07d8 admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:56:56.200527 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 4/8] 10.222.0.18 () {58 vars in 1324 bytes} [Thu Oct 13 10:56:56 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 13 10:56:56.205775 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579536a3-8754-4aa3-a65b-40578b67e268 None None] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:56:56.214913 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579536a3-8754-4aa3-a65b-40578b67e268 None None] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:56:56.219668 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1cc42bd-06c2-4527-9273-b6769cc97efc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ce4ee85562d450a9dc2f16f581130d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:56:56.220276 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cc42bd-06c2-4527-9273-b6769cc97efc admin admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:56:56.220550 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cc42bd-06c2-4527-9273-b6769cc97efc admin admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:56:56.220814 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cc42bd-06c2-4527-9273-b6769cc97efc admin admin] PATH_INFO: `/v3/users/8ba31ade43694cf8bf28f7528a9ea179` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:56:56.222126 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1cc42bd-06c2-4527-9273-b6769cc97efc admin admin] RBAC: Authorizing `identity:get_user(user_id=8ba31ade43694cf8bf28f7528a9ea179)` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:56:56.223934 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1cc42bd-06c2-4527-9273-b6769cc97efc admin admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:56:56.225475 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 5/9] 10.222.0.18 () {56 vars in 1198 bytes} [Thu Oct 13 10:56:56 2022] GET /identity/v3/users/8ba31ade43694cf8bf28f7528a9ea179 => generated 247 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 10:56:58.434649 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829a9de7-9bf9-4078-a8df-da39d9d2d3a8 None None] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:56:58.435193 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829a9de7-9bf9-4078-a8df-da39d9d2d3a8 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:56:58.435287 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829a9de7-9bf9-4078-a8df-da39d9d2d3a8 None None] PATH_INFO: `/` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:56:58.436618 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 5/10] 10.222.0.18 () {54 vars in 927 bytes} [Thu Oct 13 10:56:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 10:56:58.441899 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbb5874-d441-47af-a92b-34eceb5d3389 None None] REQUEST_METHOD: `POST` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:56:58.442304 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbb5874-d441-47af-a92b-34eceb5d3389 None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:56:58.442450 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbb5874-d441-47af-a92b-34eceb5d3389 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:56:58.460959 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.auth.core [None req-0cbb5874-d441-47af-a92b-34eceb5d3389 None None] MFA Rules not processed for user `8ba31ade43694cf8bf28f7528a9ea179`. Rule list: `[]` (Enabled: `True`). {{(pid=81533) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 10:56:58.462184 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-0cbb5874-d441-47af-a92b-34eceb5d3389 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 10:56:58.469244 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ace681-6d79-4ddf-817c-fd2b25d31cfc None None] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:56:58.469595 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ace681-6d79-4ddf-817c-fd2b25d31cfc None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:56:58.469882 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ace681-6d79-4ddf-817c-fd2b25d31cfc None None] PATH_INFO: `/` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:56:58.471206 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 6/11] 10.222.0.18 () {54 vars in 927 bytes} [Thu Oct 13 10:56:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 13 10:56:58.476218 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b0368c-f53a-4e52-9ec8-5e8787c2cced None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:56:58.476506 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b0368c-f53a-4e52-9ec8-5e8787c2cced None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:56:58.476784 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b0368c-f53a-4e52-9ec8-5e8787c2cced None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:56:58.519263 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG passlib.handlers.bcrypt [None req-f0b0368c-f53a-4e52-9ec8-5e8787c2cced None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=81534) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Oct 13 10:56:58.519680 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG passlib.handlers.bcrypt [None req-f0b0368c-f53a-4e52-9ec8-5e8787c2cced None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81534) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Oct 13 10:56:58.543588 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 6/12] 10.222.0.18 () {58 vars in 1024 bytes} [Thu Oct 13 10:56:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 13 10:56:58.569708 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-f0b0368c-f53a-4e52-9ec8-5e8787c2cced None None] MFA Rules not processed for user `8ba31ade43694cf8bf28f7528a9ea179`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 10:56:58.571304 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-f0b0368c-f53a-4e52-9ec8-5e8787c2cced None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 10:56:58.669368 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 7/13] 10.222.0.18 () {58 vars in 1024 bytes} [Thu Oct 13 10:56:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 13 10:56:58.815724 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cbb5874-d441-47af-a92b-34eceb5d3389 None None] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:56:58.840354 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:56:58.919209 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cbb5874-d441-47af-a92b-34eceb5d3389 None None] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:56:58.936123 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b0368c-f53a-4e52-9ec8-5e8787c2cced None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:56:58.953248 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09f694f-61dc-4deb-a625-d3941d9ccd52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:56:58.953881 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09f694f-61dc-4deb-a625-d3941d9ccd52 None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:56:58.954157 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09f694f-61dc-4deb-a625-d3941d9ccd52 None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:56:58.954436 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09f694f-61dc-4deb-a625-d3941d9ccd52 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:56:58.965646 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09f694f-61dc-4deb-a625-d3941d9ccd52 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 13 10:56:58.974425 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application [None req-d09f694f-61dc-4deb-a625-d3941d9ccd52 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 13 10:56:58.974425 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 10:56:58.974425 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 10:56:58.974425 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 10:56:58.974425 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 10:56:58.974425 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 10:56:58.974425 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 10:56:58.974425 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 10:56:58.974425 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 10:56:58.974425 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 10:56:58.974425 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 10:56:58.974425 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 10:56:58.974425 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 13 10:56:58.974425 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 13 10:56:58.974425 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 13 10:56:58.974425 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 13 10:56:58.975447 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 13 10:56:58.975447 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 13 10:56:58.975447 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 13 10:56:58.975447 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 13 10:56:58.975447 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 10:56:58.975447 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 10:56:58.975447 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 10:56:58.975447 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 10:56:58.975447 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 10:56:58.975447 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 10:56:58.975447 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 10:56:58.975447 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application with Lock( Oct 13 10:56:58.975447 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 10:56:58.975447 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._enter() Oct 13 10:56:58.975447 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 10:56:58.975447 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 10:56:58.976292 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 10:56:58.976292 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.creator() Oct 13 10:56:58.976292 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 10:56:58.976292 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application created_value = creator( Oct 13 10:56:58.976292 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 13 10:56:58.976292 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 13 10:56:58.976292 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 13 10:56:58.976292 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 13 10:56:58.976292 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 13 10:56:58.976292 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 13 10:56:58.976292 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 13 10:56:58.976292 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application Oct 13 10:56:58.976292 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 7/14] 10.222.0.18 () {56 vars in 1096 bytes} [Thu Oct 13 10:56:58 2022] GET /identity/v3/roles/admin => generated 83 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 10:56:58.981932 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09f694f-61dc-4deb-a625-d3941d9ccd52 None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:56:59.037816 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b0368c-f53a-4e52-9ec8-5e8787c2cced None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:56:59.040296 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:56:59.065736 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:56:59.076237 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e84211-dd65-4495-a9d1-ed63b3f57610 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:56:59.077133 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e84211-dd65-4495-a9d1-ed63b3f57610 None admin] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:56:59.077422 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e84211-dd65-4495-a9d1-ed63b3f57610 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:56:59.077700 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e84211-dd65-4495-a9d1-ed63b3f57610 None admin] PATH_INFO: `/v3/domains` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:56:59.078674 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e84211-dd65-4495-a9d1-ed63b3f57610 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:56:59.080096 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e84211-dd65-4495-a9d1-ed63b3f57610 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:56:59.083119 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09f694f-61dc-4deb-a625-d3941d9ccd52 None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:56:59.092503 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.sql.core [None req-e5e84211-dd65-4495-a9d1-ed63b3f57610 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry '<>-Default' for key 'project.ixu_project_name_domain_id'") Oct 13 10:56:59.092503 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Oct 13 10:56:59.092503 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: [parameters: {'id': '4f7d911d5db847ed8b0f28a26ca94a0e', 'name': 'Default', 'domain_id': '<>', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': None, 'is_domain': 1}] Oct 13 10:56:59.092503 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81534) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Oct 13 10:56:59.111395 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application [None req-e5e84211-dd65-4495-a9d1-ed63b3f57610 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: Default.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: Default. Oct 13 10:56:59.111395 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 10:56:59.111395 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 13 10:56:59.111395 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 13 10:56:59.111395 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 13 10:56:59.111395 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 13 10:56:59.111395 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 13 10:56:59.111395 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application result = self._query(query) Oct 13 10:56:59.111395 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 13 10:56:59.111395 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application conn.query(q) Oct 13 10:56:59.111395 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 13 10:56:59.111395 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 13 10:56:59.111395 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 13 10:56:59.111395 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application result.read() Oct 13 10:56:59.112289 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 13 10:56:59.112289 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 13 10:56:59.112289 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 13 10:56:59.112289 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 13 10:56:59.112289 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 13 10:56:59.112289 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 13 10:56:59.112289 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 13 10:56:59.112289 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 13 10:56:59.112289 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry '<>-Default' for key 'project.ixu_project_name_domain_id'") Oct 13 10:56:59.112289 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application Oct 13 10:56:59.112289 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Oct 13 10:56:59.112289 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application Oct 13 10:56:59.112289 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 10:56:59.112289 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Oct 13 10:56:59.112289 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return method(*args, **kwargs) Oct 13 10:56:59.112289 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Oct 13 10:56:59.112289 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return project_ref.to_dict() Oct 13 10:56:59.112289 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 13 10:56:59.113235 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application next(self.gen) Oct 13 10:56:59.113235 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Oct 13 10:56:59.113235 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application yield resource Oct 13 10:56:59.113235 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 13 10:56:59.113235 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application next(self.gen) Oct 13 10:56:59.113235 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Oct 13 10:56:59.113235 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application self.session.rollback() Oct 13 10:56:59.113235 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 13 10:56:59.113235 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application self.force_reraise() Oct 13 10:56:59.113235 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 13 10:56:59.113235 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application raise self.value Oct 13 10:56:59.113235 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Oct 13 10:56:59.113235 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Oct 13 10:56:59.113235 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Oct 13 10:56:59.113235 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application session.commit() Oct 13 10:56:59.113235 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Oct 13 10:56:59.113235 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Oct 13 10:56:59.114073 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Oct 13 10:56:59.114073 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application self._prepare_impl() Oct 13 10:56:59.114073 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Oct 13 10:56:59.114073 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application self.session.flush() Oct 13 10:56:59.114073 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 13 10:56:59.114073 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application self._flush(objects) Oct 13 10:56:59.114073 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 13 10:56:59.114073 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Oct 13 10:56:59.114073 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 13 10:56:59.114073 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application compat.raise_( Oct 13 10:56:59.114073 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 13 10:56:59.114073 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application raise exception Oct 13 10:56:59.114073 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 13 10:56:59.114073 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application flush_context.execute() Oct 13 10:56:59.114073 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 13 10:56:59.114073 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application rec.execute(self) Oct 13 10:56:59.114073 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 13 10:56:59.115018 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Oct 13 10:56:59.115018 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 13 10:56:59.115018 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application _emit_insert_statements( Oct 13 10:56:59.115018 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Oct 13 10:56:59.115018 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application c = connection._execute_20( Oct 13 10:56:59.115018 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 13 10:56:59.115018 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Oct 13 10:56:59.115018 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 13 10:56:59.115018 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Oct 13 10:56:59.115018 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 13 10:56:59.115018 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application ret = self._execute_context( Oct 13 10:56:59.115018 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 13 10:56:59.115018 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Oct 13 10:56:59.115018 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 13 10:56:59.115018 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 13 10:56:59.115789 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 13 10:56:59.115789 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application raise exception Oct 13 10:56:59.115789 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 13 10:56:59.115789 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 13 10:56:59.115789 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 13 10:56:59.115789 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 13 10:56:59.115789 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 13 10:56:59.115789 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application result = self._query(query) Oct 13 10:56:59.115789 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 13 10:56:59.115789 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application conn.query(q) Oct 13 10:56:59.115789 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 13 10:56:59.115789 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 13 10:56:59.115789 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 13 10:56:59.115789 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application result.read() Oct 13 10:56:59.115789 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 13 10:56:59.115789 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 13 10:56:59.115789 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 13 10:56:59.116594 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 13 10:56:59.116594 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 13 10:56:59.116594 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 13 10:56:59.116594 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 13 10:56:59.116594 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 13 10:56:59.116594 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry '<>-Default' for key 'project.ixu_project_name_domain_id'") Oct 13 10:56:59.116594 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Oct 13 10:56:59.116594 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application [parameters: {'id': '4f7d911d5db847ed8b0f28a26ca94a0e', 'name': 'Default', 'domain_id': '<>', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': None, 'is_domain': 1}] Oct 13 10:56:59.116594 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 13 10:56:59.116594 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application Oct 13 10:56:59.116594 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 13 10:56:59.116594 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application Oct 13 10:56:59.116594 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 10:56:59.116594 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Oct 13 10:56:59.116594 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Oct 13 10:56:59.117962 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Oct 13 10:56:59.117962 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Oct 13 10:56:59.117962 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name Default. Oct 13 10:56:59.117962 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application Oct 13 10:56:59.117962 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 13 10:56:59.117962 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application Oct 13 10:56:59.117962 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 10:56:59.117962 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 10:56:59.117962 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 10:56:59.117962 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 10:56:59.117962 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 10:56:59.117962 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 10:56:59.117962 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 10:56:59.117962 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 10:56:59.117962 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 10:56:59.117962 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 10:56:59.117962 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 10:56:59.119145 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 128, in post Oct 13 10:56:59.119145 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_domain( Oct 13 10:56:59.119145 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 10:56:59.119145 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 10:56:59.119145 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 765, in create_domain Oct 13 10:56:59.119145 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application is_domain_project = self.create_project( Oct 13 10:56:59.119145 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 10:56:59.119145 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 10:56:59.119145 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Oct 13 10:56:59.119145 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application raise exception.Conflict( Oct 13 10:56:59.119145 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: Default. Oct 13 10:56:59.119145 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application Oct 13 10:56:59.119145 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 8/15] 10.222.0.18 () {60 vars in 1137 bytes} [Thu Oct 13 10:56:58 2022] POST /identity/v3/domains => generated 190 bytes in 177 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Oct 13 10:56:59.119145 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e84211-dd65-4495-a9d1-ed63b3f57610 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:56:59.120953 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6a50be-a69d-41a0-90a2-38e38e7b5354 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:56:59.122221 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6a50be-a69d-41a0-90a2-38e38e7b5354 None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:56:59.122496 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6a50be-a69d-41a0-90a2-38e38e7b5354 None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:56:59.122799 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6a50be-a69d-41a0-90a2-38e38e7b5354 None admin] PATH_INFO: `/v3/roles` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:56:59.123478 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6a50be-a69d-41a0-90a2-38e38e7b5354 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81533) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 10:56:59.123781 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6a50be-a69d-41a0-90a2-38e38e7b5354 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:56:59.125222 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6a50be-a69d-41a0-90a2-38e38e7b5354 None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:56:59.141049 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 8/16] 10.222.0.18 () {56 vars in 1099 bytes} [Thu Oct 13 10:56:58 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 13 10:56:59.143732 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6a50be-a69d-41a0-90a2-38e38e7b5354 None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:56:59.218603 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e84211-dd65-4495-a9d1-ed63b3f57610 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:56:59.243179 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6a50be-a69d-41a0-90a2-38e38e7b5354 None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:56:59.252147 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2eef7b-3919-44ed-b9ec-1f16788b3f01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:56:59.252990 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2eef7b-3919-44ed-b9ec-1f16788b3f01 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:56:59.253296 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2eef7b-3919-44ed-b9ec-1f16788b3f01 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:56:59.253569 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2eef7b-3919-44ed-b9ec-1f16788b3f01 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:56:59.271875 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2eef7b-3919-44ed-b9ec-1f16788b3f01 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:56:59.273347 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2eef7b-3919-44ed-b9ec-1f16788b3f01 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:56:59.276773 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01beb9aa-4469-403b-9e9f-8a722bd59be8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:56:59.277411 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01beb9aa-4469-403b-9e9f-8a722bd59be8 None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:56:59.277714 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01beb9aa-4469-403b-9e9f-8a722bd59be8 None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:56:59.277982 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01beb9aa-4469-403b-9e9f-8a722bd59be8 None admin] PATH_INFO: `/v3/users/8ba31ade43694cf8bf28f7528a9ea179` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:56:59.279098 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01beb9aa-4469-403b-9e9f-8a722bd59be8 None admin] RBAC: Authorizing `identity:get_user(user_id=8ba31ade43694cf8bf28f7528a9ea179)` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:56:59.280535 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01beb9aa-4469-403b-9e9f-8a722bd59be8 None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:56:59.282082 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 9/17] 10.222.0.18 () {56 vars in 1177 bytes} [Thu Oct 13 10:56:59 2022] GET /identity/v3/users/8ba31ade43694cf8bf28f7528a9ea179 => generated 247 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 13 10:56:59.287415 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01beb9aa-4469-403b-9e9f-8a722bd59be8 None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:56:59.288861 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application [None req-7f2eef7b-3919-44ed-b9ec-1f16788b3f01 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 13 10:56:59.288861 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 10:56:59.288861 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 10:56:59.288861 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 10:56:59.288861 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 10:56:59.288861 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 10:56:59.288861 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 10:56:59.288861 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 10:56:59.288861 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 10:56:59.288861 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 10:56:59.288861 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 10:56:59.288861 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 10:56:59.288861 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 13 10:56:59.288861 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 13 10:56:59.288861 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 13 10:56:59.288861 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 13 10:56:59.289868 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 10:56:59.289868 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 10:56:59.289868 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 10:56:59.289868 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 10:56:59.289868 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 10:56:59.289868 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 10:56:59.289868 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 10:56:59.289868 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application with Lock( Oct 13 10:56:59.289868 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 10:56:59.289868 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._enter() Oct 13 10:56:59.289868 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 10:56:59.289868 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 10:56:59.289868 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 10:56:59.289868 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.creator() Oct 13 10:56:59.289868 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 10:56:59.289868 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application created_value = creator( Oct 13 10:56:59.289868 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 13 10:56:59.290707 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 13 10:56:59.290707 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 13 10:56:59.290707 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application Oct 13 10:56:59.290707 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 9/18] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Oct 13 10:56:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 10:56:59.295688 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2eef7b-3919-44ed-b9ec-1f16788b3f01 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:56:59.303682 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:56:59.317798 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:56:59.391549 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01beb9aa-4469-403b-9e9f-8a722bd59be8 None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:56:59.399808 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2eef7b-3919-44ed-b9ec-1f16788b3f01 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:56:59.426513 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f942c69-f755-4825-b1aa-1603265e7fba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:56:59.427171 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f942c69-f755-4825-b1aa-1603265e7fba None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:56:59.427448 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f942c69-f755-4825-b1aa-1603265e7fba None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:56:59.427723 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f942c69-f755-4825-b1aa-1603265e7fba None admin] PATH_INFO: `/v3/domains/default` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:56:59.428855 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f942c69-f755-4825-b1aa-1603265e7fba None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:56:59.430328 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f942c69-f755-4825-b1aa-1603265e7fba None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:56:59.431861 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 10/19] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Oct 13 10:56:59 2022] GET /identity/v3/domains/default => generated 199 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 13 10:56:59.434960 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06f321e-ff4b-4dc8-9738-ea0c1628d324 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:56:59.435569 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06f321e-ff4b-4dc8-9738-ea0c1628d324 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:56:59.435848 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06f321e-ff4b-4dc8-9738-ea0c1628d324 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:56:59.436117 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06f321e-ff4b-4dc8-9738-ea0c1628d324 None admin] PATH_INFO: `/v3/domains` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:56:59.436760 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06f321e-ff4b-4dc8-9738-ea0c1628d324 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 10:56:59.437126 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06f321e-ff4b-4dc8-9738-ea0c1628d324 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:56:59.438367 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f942c69-f755-4825-b1aa-1603265e7fba None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:56:59.438497 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06f321e-ff4b-4dc8-9738-ea0c1628d324 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:56:59.456468 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 10/20] 10.222.0.18 () {56 vars in 1109 bytes} [Thu Oct 13 10:56:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 13 10:56:59.524099 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:56:59.544755 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f942c69-f755-4825-b1aa-1603265e7fba None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:56:59.579958 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440376e8-ed62-4ebd-a1b7-8bb744577573 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:56:59.580642 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440376e8-ed62-4ebd-a1b7-8bb744577573 None admin] REQUEST_METHOD: `PUT` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:56:59.580918 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440376e8-ed62-4ebd-a1b7-8bb744577573 None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:56:59.581220 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440376e8-ed62-4ebd-a1b7-8bb744577573 None admin] PATH_INFO: `/v3/domains/default/users/8ba31ade43694cf8bf28f7528a9ea179/roles/30a6d59262144d4d956f4d4207864030` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:56:59.583247 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440376e8-ed62-4ebd-a1b7-8bb744577573 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=8ba31ade43694cf8bf28f7528a9ea179, role_id=30a6d59262144d4d956f4d4207864030)` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:56:59.584696 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440376e8-ed62-4ebd-a1b7-8bb744577573 None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:56:59.702871 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 11/21] 10.222.0.18 () {58 vars in 1361 bytes} [Thu Oct 13 10:56:59 2022] PUT /identity/v3/domains/default/users/8ba31ade43694cf8bf28f7528a9ea179/roles/30a6d59262144d4d956f4d4207864030 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 13 10:57:01.930281 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32826e37-6df3-4d33-b926-73a59746687c None None] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:01.930780 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32826e37-6df3-4d33-b926-73a59746687c None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:01.930851 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32826e37-6df3-4d33-b926-73a59746687c None None] PATH_INFO: `/` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:01.932154 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 11/22] 10.222.0.18 () {54 vars in 927 bytes} [Thu Oct 13 10:57:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 10:57:01.938013 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b82dab-966e-40e0-9eb6-0f6789182f54 None None] REQUEST_METHOD: `POST` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:01.938430 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b82dab-966e-40e0-9eb6-0f6789182f54 None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:01.938616 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b82dab-966e-40e0-9eb6-0f6789182f54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:01.966762 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.auth.core [None req-12b82dab-966e-40e0-9eb6-0f6789182f54 None None] MFA Rules not processed for user `8ba31ade43694cf8bf28f7528a9ea179`. Rule list: `[]` (Enabled: `True`). {{(pid=81533) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 10:57:01.968298 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-12b82dab-966e-40e0-9eb6-0f6789182f54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 10:57:02.066143 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 12/23] 10.222.0.18 () {58 vars in 1024 bytes} [Thu Oct 13 10:57:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 13 10:57:02.304426 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea59d4fd-970e-4230-b76f-10ba67ab537a None None] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:02.304775 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea59d4fd-970e-4230-b76f-10ba67ab537a None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:02.304975 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea59d4fd-970e-4230-b76f-10ba67ab537a None None] PATH_INFO: `/` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:02.306941 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 12/24] 10.222.0.18 () {54 vars in 927 bytes} [Thu Oct 13 10:57:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 10:57:02.322906 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98de605e-fad7-4174-b5bf-33f6340aab43 None None] REQUEST_METHOD: `POST` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:02.323197 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98de605e-fad7-4174-b5bf-33f6340aab43 None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:02.323387 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98de605e-fad7-4174-b5bf-33f6340aab43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:02.354582 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.auth.core [None req-98de605e-fad7-4174-b5bf-33f6340aab43 None None] MFA Rules not processed for user `8ba31ade43694cf8bf28f7528a9ea179`. Rule list: `[]` (Enabled: `True`). {{(pid=81533) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 10:57:02.355845 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-98de605e-fad7-4174-b5bf-33f6340aab43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 10:57:02.448384 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:57:02.455087 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 13/25] 10.222.0.18 () {58 vars in 1024 bytes} [Thu Oct 13 10:57:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 13 10:57:02.536668 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7d7f50-cd18-4e0a-a218-836ad0c0b895 None None] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:02.537313 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7d7f50-cd18-4e0a-a218-836ad0c0b895 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:02.537790 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7d7f50-cd18-4e0a-a218-836ad0c0b895 None None] PATH_INFO: `/` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:02.539621 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 13/26] 10.222.0.18 () {54 vars in 927 bytes} [Thu Oct 13 10:57:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 10:57:02.545560 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cff5d13-b097-4bc8-96e5-c43506582d37 None None] REQUEST_METHOD: `POST` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:02.546074 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cff5d13-b097-4bc8-96e5-c43506582d37 None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:02.546584 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cff5d13-b097-4bc8-96e5-c43506582d37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:02.568726 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.auth.core [None req-5cff5d13-b097-4bc8-96e5-c43506582d37 None None] MFA Rules not processed for user `8ba31ade43694cf8bf28f7528a9ea179`. Rule list: `[]` (Enabled: `True`). {{(pid=81533) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 10:57:02.570258 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-5cff5d13-b097-4bc8-96e5-c43506582d37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 10:57:02.591174 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7d7f50-cd18-4e0a-a218-836ad0c0b895 None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:57:02.683330 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 14/27] 10.222.0.18 () {58 vars in 1024 bytes} [Thu Oct 13 10:57:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 13 10:57:02.759922 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:57:02.778356 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec8d6e7-ffdb-4913-a384-c67a3e0fd7d7 None None] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:02.778669 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec8d6e7-ffdb-4913-a384-c67a3e0fd7d7 None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:02.778912 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec8d6e7-ffdb-4913-a384-c67a3e0fd7d7 None None] PATH_INFO: `/` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:02.784918 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 15/28] 10.222.0.18 () {54 vars in 927 bytes} [Thu Oct 13 10:57:02 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 13 10:57:02.798373 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94c3089-a13f-472c-b52f-bd066380d781 None None] REQUEST_METHOD: `POST` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:02.798662 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94c3089-a13f-472c-b52f-bd066380d781 None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:02.798931 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94c3089-a13f-472c-b52f-bd066380d781 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:02.800018 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7d7f50-cd18-4e0a-a218-836ad0c0b895 None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:57:02.838010 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.auth.core [None req-c94c3089-a13f-472c-b52f-bd066380d781 None None] MFA Rules not processed for user `8ba31ade43694cf8bf28f7528a9ea179`. Rule list: `[]` (Enabled: `True`). {{(pid=81533) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 10:57:02.839214 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-c94c3089-a13f-472c-b52f-bd066380d781 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 10:57:02.861998 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ffa1f1c-c71c-4234-b4e9-442059180997 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:57:02.862559 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffa1f1c-c71c-4234-b4e9-442059180997 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:02.862834 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffa1f1c-c71c-4234-b4e9-442059180997 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:02.863104 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffa1f1c-c71c-4234-b4e9-442059180997 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:02.885705 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ffa1f1c-c71c-4234-b4e9-442059180997 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:57:02.888480 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ffa1f1c-c71c-4234-b4e9-442059180997 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:57:02.916707 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application [None req-6ffa1f1c-c71c-4234-b4e9-442059180997 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 13 10:57:02.916707 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 10:57:02.916707 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 10:57:02.916707 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 10:57:02.916707 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 10:57:02.916707 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 10:57:02.916707 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 10:57:02.916707 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 10:57:02.916707 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 10:57:02.916707 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 10:57:02.916707 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 10:57:02.916707 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 10:57:02.916707 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 13 10:57:02.916707 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 13 10:57:02.916707 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 13 10:57:02.916707 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 13 10:57:02.917664 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 10:57:02.917664 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 10:57:02.917664 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 10:57:02.917664 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 10:57:02.917664 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 10:57:02.917664 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 10:57:02.917664 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 10:57:02.917664 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application with Lock( Oct 13 10:57:02.917664 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 10:57:02.917664 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._enter() Oct 13 10:57:02.917664 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 10:57:02.917664 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 10:57:02.917664 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 10:57:02.917664 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.creator() Oct 13 10:57:02.917664 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 10:57:02.917664 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application created_value = creator( Oct 13 10:57:02.917664 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 13 10:57:02.918554 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 13 10:57:02.918554 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 13 10:57:02.918554 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application Oct 13 10:57:02.918554 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 14/29] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Oct 13 10:57:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 327 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 10:57:02.920711 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ffa1f1c-c71c-4234-b4e9-442059180997 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:57:02.963082 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 16/30] 10.222.0.18 () {58 vars in 1024 bytes} [Thu Oct 13 10:57:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 13 10:57:02.963807 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94c3089-a13f-472c-b52f-bd066380d781 None None] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:57:03.087047 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:57:03.117251 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ffa1f1c-c71c-4234-b4e9-442059180997 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:57:03.142426 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94c3089-a13f-472c-b52f-bd066380d781 None None] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:57:03.166265 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:57:03.181922 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26ac889-e92b-47df-9ea4-2b1cc9399f79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:57:03.182669 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26ac889-e92b-47df-9ea4-2b1cc9399f79 None admin] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:03.182952 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26ac889-e92b-47df-9ea4-2b1cc9399f79 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:03.183325 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26ac889-e92b-47df-9ea4-2b1cc9399f79 None admin] PATH_INFO: `/v3/roles` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:03.185084 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26ac889-e92b-47df-9ea4-2b1cc9399f79 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:57:03.186460 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26ac889-e92b-47df-9ea4-2b1cc9399f79 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:57:03.198052 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2903ea8-fe80-4c35-a9e6-1452827fba18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:57:03.202687 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2903ea8-fe80-4c35-a9e6-1452827fba18 None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:03.202978 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2903ea8-fe80-4c35-a9e6-1452827fba18 None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:03.204333 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2903ea8-fe80-4c35-a9e6-1452827fba18 None admin] PATH_INFO: `/v3/domains` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:03.204996 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2903ea8-fe80-4c35-a9e6-1452827fba18 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81533) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 10:57:03.205530 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2903ea8-fe80-4c35-a9e6-1452827fba18 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:57:03.209768 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2903ea8-fe80-4c35-a9e6-1452827fba18 None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:57:03.244146 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 17/31] 10.222.0.18 () {56 vars in 1109 bytes} [Thu Oct 13 10:57:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 10:57:03.245315 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2903ea8-fe80-4c35-a9e6-1452827fba18 None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:57:03.337989 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 15/32] 10.222.0.18 () {60 vars in 1131 bytes} [Thu Oct 13 10:57:02 2022] POST /identity/v3/roles => generated 219 bytes in 420 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 13 10:57:03.338946 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26ac889-e92b-47df-9ea4-2b1cc9399f79 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:57:03.479829 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2903ea8-fe80-4c35-a9e6-1452827fba18 None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:57:03.492429 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26ac889-e92b-47df-9ea4-2b1cc9399f79 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:57:03.532365 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b397fa-a11f-4b0c-9994-6ed04b137e58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:57:03.533456 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b397fa-a11f-4b0c-9994-6ed04b137e58 None admin] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:03.534150 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:57:03.534843 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b397fa-a11f-4b0c-9994-6ed04b137e58 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:03.535335 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b397fa-a11f-4b0c-9994-6ed04b137e58 None admin] PATH_INFO: `/v3/projects` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:03.536242 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b397fa-a11f-4b0c-9994-6ed04b137e58 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:57:03.538182 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b397fa-a11f-4b0c-9994-6ed04b137e58 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:57:03.569124 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204701c4-fa5d-4338-a21c-ad74b3efde43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:57:03.570166 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204701c4-fa5d-4338-a21c-ad74b3efde43 None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:03.570629 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204701c4-fa5d-4338-a21c-ad74b3efde43 None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:03.571095 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204701c4-fa5d-4338-a21c-ad74b3efde43 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:03.584510 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204701c4-fa5d-4338-a21c-ad74b3efde43 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 13 10:57:03.587201 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 16/33] 10.222.0.18 () {60 vars in 1141 bytes} [Thu Oct 13 10:57:03 2022] POST /identity/v3/projects => generated 301 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 13 10:57:03.588213 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b397fa-a11f-4b0c-9994-6ed04b137e58 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:57:03.591374 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application [None req-204701c4-fa5d-4338-a21c-ad74b3efde43 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 13 10:57:03.591374 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 10:57:03.591374 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 10:57:03.591374 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 10:57:03.591374 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 10:57:03.591374 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 10:57:03.591374 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 10:57:03.591374 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 10:57:03.591374 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 10:57:03.591374 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 10:57:03.591374 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 10:57:03.591374 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 10:57:03.591374 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 13 10:57:03.591374 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 13 10:57:03.591374 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 13 10:57:03.591374 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 13 10:57:03.592307 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 13 10:57:03.592307 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 13 10:57:03.592307 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 13 10:57:03.592307 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 13 10:57:03.592307 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 10:57:03.592307 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 10:57:03.592307 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 10:57:03.592307 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 10:57:03.592307 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 10:57:03.592307 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 10:57:03.592307 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 10:57:03.592307 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application with Lock( Oct 13 10:57:03.592307 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 10:57:03.592307 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._enter() Oct 13 10:57:03.592307 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 10:57:03.592307 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 10:57:03.593142 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 10:57:03.593142 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.creator() Oct 13 10:57:03.593142 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 10:57:03.593142 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application created_value = creator( Oct 13 10:57:03.593142 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 13 10:57:03.593142 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 13 10:57:03.593142 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 13 10:57:03.593142 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 13 10:57:03.593142 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 13 10:57:03.593142 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 13 10:57:03.593142 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 13 10:57:03.593142 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application Oct 13 10:57:03.595715 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 18/34] 10.222.0.18 () {56 vars in 1096 bytes} [Thu Oct 13 10:57:03 2022] GET /identity/v3/roles/admin => generated 83 bytes in 351 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 10:57:03.597761 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5457f5-3bab-4e01-9e9b-505ca146a537 None None] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:03.598254 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5457f5-3bab-4e01-9e9b-505ca146a537 None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:03.598676 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5457f5-3bab-4e01-9e9b-505ca146a537 None None] PATH_INFO: `/` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:03.600491 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 19/35] 10.222.0.18 () {54 vars in 927 bytes} [Thu Oct 13 10:57:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 10:57:03.601493 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5457f5-3bab-4e01-9e9b-505ca146a537 None None] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:57:03.659788 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:57:03.742607 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5457f5-3bab-4e01-9e9b-505ca146a537 None None] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:57:03.744651 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b397fa-a11f-4b0c-9994-6ed04b137e58 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:57:03.787282 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da7e3e4-da64-4449-b990-770689ce4336 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:57:03.788066 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da7e3e4-da64-4449-b990-770689ce4336 None admin] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:03.788452 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da7e3e4-da64-4449-b990-770689ce4336 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:03.788831 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da7e3e4-da64-4449-b990-770689ce4336 None admin] PATH_INFO: `/v3/roles` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:03.789683 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da7e3e4-da64-4449-b990-770689ce4336 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:57:03.793664 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da7e3e4-da64-4449-b990-770689ce4336 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:57:03.816655 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 17/36] 10.222.0.18 () {60 vars in 1131 bytes} [Thu Oct 13 10:57:03 2022] POST /identity/v3/roles => generated 225 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 13 10:57:03.818526 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addf4b79-579f-4b6a-9565-b9077870926e None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:03.818925 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addf4b79-579f-4b6a-9565-b9077870926e None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:03.819364 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addf4b79-579f-4b6a-9565-b9077870926e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:03.844303 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-addf4b79-579f-4b6a-9565-b9077870926e None None] MFA Rules not processed for user `8ba31ade43694cf8bf28f7528a9ea179`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 10:57:03.846234 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-addf4b79-579f-4b6a-9565-b9077870926e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 10:57:03.904585 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35be8e83-9ff1-4f46-8713-87b913643a5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:57:03.905609 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35be8e83-9ff1-4f46-8713-87b913643a5b None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:03.906066 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35be8e83-9ff1-4f46-8713-87b913643a5b None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:03.906594 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35be8e83-9ff1-4f46-8713-87b913643a5b None admin] PATH_INFO: `/v3/roles` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:03.907514 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35be8e83-9ff1-4f46-8713-87b913643a5b None admin] RBAC: Adding query filter params (name=admin) {{(pid=81533) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 10:57:03.908055 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35be8e83-9ff1-4f46-8713-87b913643a5b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:57:03.909856 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35be8e83-9ff1-4f46-8713-87b913643a5b None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:57:03.921405 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 20/37] 10.222.0.18 () {56 vars in 1099 bytes} [Thu Oct 13 10:57:03 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 320 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 10:57:03.926766 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35be8e83-9ff1-4f46-8713-87b913643a5b None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:57:03.930509 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 18/38] 10.222.0.18 () {58 vars in 1024 bytes} [Thu Oct 13 10:57:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 13 10:57:03.980587 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:57:04.052464 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35be8e83-9ff1-4f46-8713-87b913643a5b None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:57:04.088841 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035461af-57e9-4493-afdf-a40701443513 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:57:04.089896 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035461af-57e9-4493-afdf-a40701443513 None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:04.090379 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035461af-57e9-4493-afdf-a40701443513 None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:04.090854 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035461af-57e9-4493-afdf-a40701443513 None admin] PATH_INFO: `/v3/users/8ba31ade43694cf8bf28f7528a9ea179` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:04.092226 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035461af-57e9-4493-afdf-a40701443513 None admin] RBAC: Authorizing `identity:get_user(user_id=8ba31ade43694cf8bf28f7528a9ea179)` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:57:04.093900 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035461af-57e9-4493-afdf-a40701443513 None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:57:04.095803 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 21/39] 10.222.0.18 () {56 vars in 1177 bytes} [Thu Oct 13 10:57:03 2022] GET /identity/v3/users/8ba31ade43694cf8bf28f7528a9ea179 => generated 247 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 13 10:57:04.102259 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-addf4b79-579f-4b6a-9565-b9077870926e None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:57:04.133243 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10706f9c-578b-430e-a077-afebf3246fb0 None None] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:04.133543 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10706f9c-578b-430e-a077-afebf3246fb0 None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:04.133795 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10706f9c-578b-430e-a077-afebf3246fb0 None None] PATH_INFO: `/` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:04.135142 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 22/40] 10.222.0.18 () {54 vars in 927 bytes} [Thu Oct 13 10:57:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 13 10:57:04.140804 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e025da30-1483-477f-816d-a147769f759e None None] REQUEST_METHOD: `POST` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:04.141127 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e025da30-1483-477f-816d-a147769f759e None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:04.141419 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e025da30-1483-477f-816d-a147769f759e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:04.141702 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:57:04.160739 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.auth.core [None req-e025da30-1483-477f-816d-a147769f759e None None] MFA Rules not processed for user `8ba31ade43694cf8bf28f7528a9ea179`. Rule list: `[]` (Enabled: `True`). {{(pid=81533) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 10:57:04.161958 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-e025da30-1483-477f-816d-a147769f759e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 10:57:04.214291 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-addf4b79-579f-4b6a-9565-b9077870926e None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:57:04.230493 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 23/41] 10.222.0.18 () {58 vars in 1024 bytes} [Thu Oct 13 10:57:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 13 10:57:04.231395 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e025da30-1483-477f-816d-a147769f759e None None] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:57:04.251068 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e472c80a-878a-478b-84fd-761f84b6f434 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:57:04.251912 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e472c80a-878a-478b-84fd-761f84b6f434 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:04.252198 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e472c80a-878a-478b-84fd-761f84b6f434 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:04.252474 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e472c80a-878a-478b-84fd-761f84b6f434 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:04.253626 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e472c80a-878a-478b-84fd-761f84b6f434 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:57:04.255060 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e472c80a-878a-478b-84fd-761f84b6f434 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:57:04.256641 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 19/42] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Oct 13 10:57:04 2022] GET /identity/v3/domains/default => generated 199 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 10:57:04.263448 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e472c80a-878a-478b-84fd-761f84b6f434 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:57:04.283001 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:57:04.344243 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e025da30-1483-477f-816d-a147769f759e None None] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:57:04.369409 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e472c80a-878a-478b-84fd-761f84b6f434 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:57:04.372299 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:57:04.379774 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef94625-5c78-45e5-9dd5-11991badc985 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:57:04.380388 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef94625-5c78-45e5-9dd5-11991badc985 None admin] REQUEST_METHOD: `POST` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:04.380670 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef94625-5c78-45e5-9dd5-11991badc985 None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:04.380940 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef94625-5c78-45e5-9dd5-11991badc985 None admin] PATH_INFO: `/v3/roles` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:04.381644 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef94625-5c78-45e5-9dd5-11991badc985 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:57:04.383282 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef94625-5c78-45e5-9dd5-11991badc985 None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:57:04.404226 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 24/43] 10.222.0.18 () {60 vars in 1131 bytes} [Thu Oct 13 10:57:04 2022] POST /identity/v3/roles => generated 223 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 13 10:57:04.408483 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b5acc3-8db3-4835-9c6b-eb0f429688c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:57:04.409310 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b5acc3-8db3-4835-9c6b-eb0f429688c6 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:04.409549 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b5acc3-8db3-4835-9c6b-eb0f429688c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:04.409901 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b5acc3-8db3-4835-9c6b-eb0f429688c6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:04.410590 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b5acc3-8db3-4835-9c6b-eb0f429688c6 None admin] RBAC: Adding query filter params (role.id=30a6d59262144d4d956f4d4207864030, scope.domain.id=default, user.id=8ba31ade43694cf8bf28f7528a9ea179) {{(pid=81534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 10:57:04.410882 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b5acc3-8db3-4835-9c6b-eb0f429688c6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:57:04.412559 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b5acc3-8db3-4835-9c6b-eb0f429688c6 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:57:04.426412 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 20/44] 10.222.0.18 () {56 vars in 1322 bytes} [Thu Oct 13 10:57:04 2022] GET /identity/v3/role_assignments?user.id=8ba31ade43694cf8bf28f7528a9ea179&scope.domain.id=default&role.id=30a6d59262144d4d956f4d4207864030 => generated 530 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 13 10:57:04.504187 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef94625-5c78-45e5-9dd5-11991badc985 None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:57:04.618938 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:57:04.622389 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef94625-5c78-45e5-9dd5-11991badc985 None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:57:04.661921 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca08edb1-272b-4a94-a373-37f7a23ba6c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:57:04.662588 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca08edb1-272b-4a94-a373-37f7a23ba6c4 None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:04.662870 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca08edb1-272b-4a94-a373-37f7a23ba6c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:04.663143 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca08edb1-272b-4a94-a373-37f7a23ba6c4 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:04.664279 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca08edb1-272b-4a94-a373-37f7a23ba6c4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:57:04.665789 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca08edb1-272b-4a94-a373-37f7a23ba6c4 None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:57:04.667569 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 25/45] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Oct 13 10:57:04 2022] GET /identity/v3/domains/default => generated 199 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 10:57:04.673125 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b5acc3-8db3-4835-9c6b-eb0f429688c6 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:57:04.771969 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b5acc3-8db3-4835-9c6b-eb0f429688c6 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:57:04.804710 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8a461a-cad6-4859-af8b-25ce53c2f029 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:57:04.805334 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8a461a-cad6-4859-af8b-25ce53c2f029 None admin] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:04.805613 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8a461a-cad6-4859-af8b-25ce53c2f029 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:04.805883 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8a461a-cad6-4859-af8b-25ce53c2f029 None admin] PATH_INFO: `/v3/projects` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:04.806538 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8a461a-cad6-4859-af8b-25ce53c2f029 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:57:04.807977 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8a461a-cad6-4859-af8b-25ce53c2f029 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:57:04.833009 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 21/46] 10.222.0.18 () {60 vars in 1141 bytes} [Thu Oct 13 10:57:04 2022] POST /identity/v3/projects => generated 312 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 13 10:57:06.969895 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c18ffc1-1253-4918-8a86-fbe74e82e065 None None] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:06.970410 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c18ffc1-1253-4918-8a86-fbe74e82e065 None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:06.970496 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c18ffc1-1253-4918-8a86-fbe74e82e065 None None] PATH_INFO: `/` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:06.971785 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 26/47] 10.222.0.18 () {54 vars in 927 bytes} [Thu Oct 13 10:57:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 10:57:06.977117 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba12ad81-726c-4920-ade0-e0010a3d91b9 None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:06.977520 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba12ad81-726c-4920-ade0-e0010a3d91b9 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:06.977673 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba12ad81-726c-4920-ade0-e0010a3d91b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:06.995441 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-ba12ad81-726c-4920-ade0-e0010a3d91b9 None None] MFA Rules not processed for user `8ba31ade43694cf8bf28f7528a9ea179`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 10:57:06.996598 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-ba12ad81-726c-4920-ade0-e0010a3d91b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 10:57:07.009337 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:57:07.061172 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 22/48] 10.222.0.18 () {58 vars in 1024 bytes} [Thu Oct 13 10:57:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 13 10:57:07.329106 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c18ffc1-1253-4918-8a86-fbe74e82e065 None None] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:57:07.429653 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c18ffc1-1253-4918-8a86-fbe74e82e065 None None] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:57:07.462211 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59a1fda-7ed7-4048-b7e7-e460ae1bc8d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:57:07.462831 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59a1fda-7ed7-4048-b7e7-e460ae1bc8d3 None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:07.463112 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59a1fda-7ed7-4048-b7e7-e460ae1bc8d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:07.463383 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59a1fda-7ed7-4048-b7e7-e460ae1bc8d3 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:07.465041 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59a1fda-7ed7-4048-b7e7-e460ae1bc8d3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:57:07.466501 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59a1fda-7ed7-4048-b7e7-e460ae1bc8d3 None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:57:07.468037 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 27/49] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Oct 13 10:57:07 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 10:57:07.473675 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba12ad81-726c-4920-ade0-e0010a3d91b9 None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:57:07.569882 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba12ad81-726c-4920-ade0-e0010a3d91b9 None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:57:07.602805 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d088af-cec2-47a2-a4bd-eed68231f59e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:57:07.603340 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d088af-cec2-47a2-a4bd-eed68231f59e None admin] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:07.603619 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d088af-cec2-47a2-a4bd-eed68231f59e None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:07.603893 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d088af-cec2-47a2-a4bd-eed68231f59e None admin] PATH_INFO: `/v3/projects` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:07.604551 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d088af-cec2-47a2-a4bd-eed68231f59e None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:57:07.606186 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d088af-cec2-47a2-a4bd-eed68231f59e None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:57:07.626535 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:57:07.633195 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 23/50] 10.222.0.18 () {60 vars in 1140 bytes} [Thu Oct 13 10:57:07 2022] POST /identity/v3/projects => generated 298 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 13 10:57:09.768140 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26b0a5e-784f-41d2-a92d-2c293898a32f None None] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:09.768596 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26b0a5e-784f-41d2-a92d-2c293898a32f None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:09.768703 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26b0a5e-784f-41d2-a92d-2c293898a32f None None] PATH_INFO: `/` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:09.770066 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 28/51] 10.222.0.18 () {54 vars in 927 bytes} [Thu Oct 13 10:57:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 10:57:09.775212 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3885f9cf-ff8f-4bee-bc31-ec136964429c None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:09.775642 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3885f9cf-ff8f-4bee-bc31-ec136964429c None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:09.775762 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3885f9cf-ff8f-4bee-bc31-ec136964429c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:09.898316 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-3885f9cf-ff8f-4bee-bc31-ec136964429c None None] MFA Rules not processed for user `8ba31ade43694cf8bf28f7528a9ea179`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 10:57:09.899502 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-3885f9cf-ff8f-4bee-bc31-ec136964429c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 10:57:09.964306 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 24/52] 10.222.0.18 () {58 vars in 1024 bytes} [Thu Oct 13 10:57:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 13 10:57:10.234046 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26b0a5e-784f-41d2-a92d-2c293898a32f None None] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:57:10.270484 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:57:10.334122 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26b0a5e-784f-41d2-a92d-2c293898a32f None None] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:57:10.366868 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b5682a-2c5f-43f2-8d36-bf394efa082e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:57:10.367485 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b5682a-2c5f-43f2-8d36-bf394efa082e None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:10.367765 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b5682a-2c5f-43f2-8d36-bf394efa082e None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:10.368035 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b5682a-2c5f-43f2-8d36-bf394efa082e None admin] PATH_INFO: `/v3/domains/default` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:10.369165 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b5682a-2c5f-43f2-8d36-bf394efa082e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:57:10.370629 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b5682a-2c5f-43f2-8d36-bf394efa082e None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:57:10.372161 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 29/53] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Oct 13 10:57:10 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 10:57:10.377671 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3885f9cf-ff8f-4bee-bc31-ec136964429c None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:57:10.475208 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3885f9cf-ff8f-4bee-bc31-ec136964429c None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:57:10.502901 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:57:10.509114 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbcbf20c-4528-4e16-a6ab-7ca0abf45b91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:57:10.509720 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcbf20c-4528-4e16-a6ab-7ca0abf45b91 None admin] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:10.510005 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcbf20c-4528-4e16-a6ab-7ca0abf45b91 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:10.510281 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcbf20c-4528-4e16-a6ab-7ca0abf45b91 None admin] PATH_INFO: `/v3/users` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:10.510945 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbcbf20c-4528-4e16-a6ab-7ca0abf45b91 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:57:10.512597 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbcbf20c-4528-4e16-a6ab-7ca0abf45b91 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:57:10.538194 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 25/54] 10.222.0.18 () {60 vars in 1132 bytes} [Thu Oct 13 10:57:10 2022] POST /identity/v3/users => generated 275 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 13 10:57:13.824647 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56088d60-6485-421a-a952-41c82462a233 None None] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:13.825640 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56088d60-6485-421a-a952-41c82462a233 None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:13.826120 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56088d60-6485-421a-a952-41c82462a233 None None] PATH_INFO: `/` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:13.827739 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 30/55] 10.222.0.18 () {54 vars in 927 bytes} [Thu Oct 13 10:57:13 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 10:57:13.833327 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e262ccb-d14f-465b-b2e8-a9cd44bd803e None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:13.834212 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e262ccb-d14f-465b-b2e8-a9cd44bd803e None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:13.834690 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e262ccb-d14f-465b-b2e8-a9cd44bd803e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:13.856008 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0f13e4-9ede-498a-864f-1eb4340c1575 None None] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:13.856621 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0f13e4-9ede-498a-864f-1eb4340c1575 None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:13.857131 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0f13e4-9ede-498a-864f-1eb4340c1575 None None] PATH_INFO: `/` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:13.858748 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 31/56] 10.222.0.18 () {54 vars in 927 bytes} [Thu Oct 13 10:57:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 13 10:57:13.863416 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-0e262ccb-d14f-465b-b2e8-a9cd44bd803e None None] MFA Rules not processed for user `8ba31ade43694cf8bf28f7528a9ea179`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 10:57:13.863816 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d530742-f06f-4f2f-94a1-eb7c69d68987 None None] REQUEST_METHOD: `POST` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:13.864298 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d530742-f06f-4f2f-94a1-eb7c69d68987 None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:13.864670 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-0e262ccb-d14f-465b-b2e8-a9cd44bd803e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 10:57:13.865037 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d530742-f06f-4f2f-94a1-eb7c69d68987 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:13.891571 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.auth.core [None req-0d530742-f06f-4f2f-94a1-eb7c69d68987 None None] MFA Rules not processed for user `8ba31ade43694cf8bf28f7528a9ea179`. Rule list: `[]` (Enabled: `True`). {{(pid=81533) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 10:57:13.894544 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-0d530742-f06f-4f2f-94a1-eb7c69d68987 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 10:57:13.988792 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 26/57] 10.222.0.18 () {58 vars in 1024 bytes} [Thu Oct 13 10:57:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 13 10:57:14.006073 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 32/58] 10.222.0.18 () {58 vars in 1024 bytes} [Thu Oct 13 10:57:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 13 10:57:14.156088 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cb598d-d51c-4d1a-b313-fe1848df8b18 None None] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:14.156782 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cb598d-d51c-4d1a-b313-fe1848df8b18 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:14.157357 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cb598d-d51c-4d1a-b313-fe1848df8b18 None None] PATH_INFO: `/` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:14.158924 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 27/59] 10.222.0.18 () {54 vars in 927 bytes} [Thu Oct 13 10:57:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 10:57:14.164296 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70cac02-08ae-4ed8-b4b3-b10278fd7c74 None None] REQUEST_METHOD: `POST` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:14.164806 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70cac02-08ae-4ed8-b4b3-b10278fd7c74 None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:14.165367 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70cac02-08ae-4ed8-b4b3-b10278fd7c74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:14.185051 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.auth.core [None req-e70cac02-08ae-4ed8-b4b3-b10278fd7c74 None None] MFA Rules not processed for user `8ba31ade43694cf8bf28f7528a9ea179`. Rule list: `[]` (Enabled: `True`). {{(pid=81533) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 10:57:14.186560 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-e70cac02-08ae-4ed8-b4b3-b10278fd7c74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 10:57:14.195803 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b84a2f0-a1f9-4ba3-8509-3afb5135b499 None None] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:14.196375 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b84a2f0-a1f9-4ba3-8509-3afb5135b499 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:14.196868 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b84a2f0-a1f9-4ba3-8509-3afb5135b499 None None] PATH_INFO: `/` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:14.198565 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 28/60] 10.222.0.18 () {54 vars in 927 bytes} [Thu Oct 13 10:57:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 13 10:57:14.203780 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfb89d3-61d4-4c13-b36a-f7e2bb5a847f None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:14.204314 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfb89d3-61d4-4c13-b36a-f7e2bb5a847f None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:14.204790 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfb89d3-61d4-4c13-b36a-f7e2bb5a847f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:14.227687 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-fdfb89d3-61d4-4c13-b36a-f7e2bb5a847f None None] MFA Rules not processed for user `8ba31ade43694cf8bf28f7528a9ea179`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 10:57:14.230322 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-fdfb89d3-61d4-4c13-b36a-f7e2bb5a847f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 10:57:14.251636 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:57:14.318679 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 33/61] 10.222.0.18 () {58 vars in 1024 bytes} [Thu Oct 13 10:57:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 13 10:57:14.354033 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 29/62] 10.222.0.18 () {58 vars in 1024 bytes} [Thu Oct 13 10:57:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 13 10:57:14.361467 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70cac02-08ae-4ed8-b4b3-b10278fd7c74 None None] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:57:14.399644 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfb89d3-61d4-4c13-b36a-f7e2bb5a847f None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:57:14.492093 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:57:14.530613 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70cac02-08ae-4ed8-b4b3-b10278fd7c74 None None] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:57:14.594261 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfb89d3-61d4-4c13-b36a-f7e2bb5a847f None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:57:14.598938 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b10157-2498-40e0-b490-675e64fe4835 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:57:14.599949 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b10157-2498-40e0-b490-675e64fe4835 None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:14.601346 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b10157-2498-40e0-b490-675e64fe4835 None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:14.601857 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b10157-2498-40e0-b490-675e64fe4835 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:14.624600 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b10157-2498-40e0-b490-675e64fe4835 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 13 10:57:14.629883 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application [None req-e4b10157-2498-40e0-b490-675e64fe4835 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 13 10:57:14.629883 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 10:57:14.629883 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 10:57:14.629883 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 10:57:14.629883 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 10:57:14.629883 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 10:57:14.629883 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 10:57:14.629883 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 10:57:14.629883 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 10:57:14.629883 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 10:57:14.629883 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 10:57:14.629883 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 10:57:14.629883 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 13 10:57:14.629883 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 13 10:57:14.629883 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 13 10:57:14.629883 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 13 10:57:14.630738 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 13 10:57:14.630738 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 13 10:57:14.630738 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 13 10:57:14.630738 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 13 10:57:14.630738 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 10:57:14.630738 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 10:57:14.630738 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 10:57:14.630738 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 10:57:14.630738 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 10:57:14.630738 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 10:57:14.630738 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 10:57:14.630738 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application with Lock( Oct 13 10:57:14.630738 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 10:57:14.630738 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._enter() Oct 13 10:57:14.630738 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 10:57:14.630738 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 10:57:14.631543 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 10:57:14.631543 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.creator() Oct 13 10:57:14.631543 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 10:57:14.631543 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application created_value = creator( Oct 13 10:57:14.631543 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 13 10:57:14.631543 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 13 10:57:14.631543 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 13 10:57:14.631543 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 13 10:57:14.631543 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 13 10:57:14.631543 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 13 10:57:14.631543 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 13 10:57:14.631543 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application Oct 13 10:57:14.636279 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 34/63] 10.222.0.18 () {56 vars in 1096 bytes} [Thu Oct 13 10:57:14 2022] GET /identity/v3/roles/admin => generated 83 bytes in 275 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 10:57:14.642617 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b10157-2498-40e0-b490-675e64fe4835 None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:57:14.659666 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b08fd9-8e76-476b-8dc5-9b6c1b330d61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:57:14.660485 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b08fd9-8e76-476b-8dc5-9b6c1b330d61 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:14.660770 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b08fd9-8e76-476b-8dc5-9b6c1b330d61 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:14.661069 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b08fd9-8e76-476b-8dc5-9b6c1b330d61 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:14.673203 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b08fd9-8e76-476b-8dc5-9b6c1b330d61 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 13 10:57:14.674033 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:57:14.681141 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application [None req-c9b08fd9-8e76-476b-8dc5-9b6c1b330d61 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 13 10:57:14.681141 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 10:57:14.681141 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 10:57:14.681141 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 10:57:14.681141 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 10:57:14.681141 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 10:57:14.681141 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 10:57:14.681141 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 10:57:14.681141 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 10:57:14.681141 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 10:57:14.681141 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 10:57:14.681141 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 10:57:14.681141 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 13 10:57:14.681141 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 13 10:57:14.681141 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 13 10:57:14.681141 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 13 10:57:14.682014 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 13 10:57:14.682014 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 13 10:57:14.682014 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 13 10:57:14.682014 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 13 10:57:14.682014 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 10:57:14.682014 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 10:57:14.682014 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 10:57:14.682014 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 10:57:14.682014 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 10:57:14.682014 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 10:57:14.682014 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 10:57:14.682014 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application with Lock( Oct 13 10:57:14.682014 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 10:57:14.682014 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._enter() Oct 13 10:57:14.682014 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 10:57:14.682014 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 10:57:14.682920 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 10:57:14.682920 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.creator() Oct 13 10:57:14.682920 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 10:57:14.682920 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application created_value = creator( Oct 13 10:57:14.682920 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 13 10:57:14.682920 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 13 10:57:14.682920 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 13 10:57:14.682920 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 13 10:57:14.682920 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 13 10:57:14.682920 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 13 10:57:14.682920 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 13 10:57:14.682920 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application Oct 13 10:57:14.682920 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 30/64] 10.222.0.18 () {56 vars in 1099 bytes} [Thu Oct 13 10:57:14 2022] GET /identity/v3/roles/member => generated 84 bytes in 283 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 13 10:57:14.683745 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b08fd9-8e76-476b-8dc5-9b6c1b330d61 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:57:14.755555 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b10157-2498-40e0-b490-675e64fe4835 None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:57:14.785530 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b08fd9-8e76-476b-8dc5-9b6c1b330d61 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:57:14.790329 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be719fe-c9fd-4f18-8431-e4af3926b0af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:57:14.790935 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be719fe-c9fd-4f18-8431-e4af3926b0af None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:14.791215 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be719fe-c9fd-4f18-8431-e4af3926b0af None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:14.791489 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be719fe-c9fd-4f18-8431-e4af3926b0af None admin] PATH_INFO: `/v3/roles` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:14.792647 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be719fe-c9fd-4f18-8431-e4af3926b0af None admin] RBAC: Adding query filter params (name=admin) {{(pid=81533) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 10:57:14.792955 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be719fe-c9fd-4f18-8431-e4af3926b0af None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:57:14.793191 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:57:14.794475 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be719fe-c9fd-4f18-8431-e4af3926b0af None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:57:14.803103 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 35/65] 10.222.0.18 () {56 vars in 1099 bytes} [Thu Oct 13 10:57:14 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 10:57:14.803892 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be719fe-c9fd-4f18-8431-e4af3926b0af None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:57:14.820655 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df63bcf1-c3f5-47cd-a43c-eb4ea8fbd274 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:57:14.821319 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df63bcf1-c3f5-47cd-a43c-eb4ea8fbd274 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:14.821604 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df63bcf1-c3f5-47cd-a43c-eb4ea8fbd274 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:14.821887 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df63bcf1-c3f5-47cd-a43c-eb4ea8fbd274 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:14.831756 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df63bcf1-c3f5-47cd-a43c-eb4ea8fbd274 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 13 10:57:14.836652 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application [None req-df63bcf1-c3f5-47cd-a43c-eb4ea8fbd274 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 13 10:57:14.836652 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 10:57:14.836652 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 10:57:14.836652 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 10:57:14.836652 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 10:57:14.836652 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 10:57:14.836652 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 10:57:14.836652 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 10:57:14.836652 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 10:57:14.836652 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 10:57:14.836652 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 10:57:14.836652 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 10:57:14.836652 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 13 10:57:14.836652 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 13 10:57:14.836652 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 13 10:57:14.836652 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 13 10:57:14.838160 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 13 10:57:14.838160 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 13 10:57:14.838160 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 13 10:57:14.838160 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 13 10:57:14.838160 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 10:57:14.838160 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 10:57:14.838160 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 10:57:14.838160 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 10:57:14.838160 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 10:57:14.838160 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 10:57:14.838160 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 10:57:14.838160 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application with Lock( Oct 13 10:57:14.838160 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 10:57:14.838160 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._enter() Oct 13 10:57:14.838160 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 10:57:14.838160 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 10:57:14.839800 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 10:57:14.839800 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.creator() Oct 13 10:57:14.839800 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 10:57:14.839800 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application created_value = creator( Oct 13 10:57:14.839800 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 13 10:57:14.839800 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 13 10:57:14.839800 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 13 10:57:14.839800 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 13 10:57:14.839800 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 13 10:57:14.839800 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 13 10:57:14.839800 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 13 10:57:14.839800 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application Oct 13 10:57:14.839800 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 31/66] 10.222.0.18 () {56 vars in 1114 bytes} [Thu Oct 13 10:57:14 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 10:57:14.839800 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df63bcf1-c3f5-47cd-a43c-eb4ea8fbd274 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:57:14.894760 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:57:14.910653 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be719fe-c9fd-4f18-8431-e4af3926b0af None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:57:14.938043 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df63bcf1-c3f5-47cd-a43c-eb4ea8fbd274 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:57:14.943942 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5a7a5c-17c9-47a8-a533-fdd4619b9037 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:57:14.944572 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5a7a5c-17c9-47a8-a533-fdd4619b9037 None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:14.944855 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5a7a5c-17c9-47a8-a533-fdd4619b9037 None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:14.945176 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5a7a5c-17c9-47a8-a533-fdd4619b9037 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:14.955183 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5a7a5c-17c9-47a8-a533-fdd4619b9037 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 13 10:57:14.960458 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application [None req-ec5a7a5c-17c9-47a8-a533-fdd4619b9037 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 13 10:57:14.960458 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 10:57:14.960458 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 10:57:14.960458 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 10:57:14.960458 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 10:57:14.960458 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 10:57:14.960458 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 10:57:14.960458 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 10:57:14.960458 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 10:57:14.960458 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 10:57:14.960458 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 10:57:14.960458 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 10:57:14.960458 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 13 10:57:14.960458 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 13 10:57:14.960458 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 13 10:57:14.960458 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 13 10:57:14.961354 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 13 10:57:14.961354 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 13 10:57:14.961354 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 13 10:57:14.961354 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 13 10:57:14.961354 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 10:57:14.961354 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 10:57:14.961354 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 10:57:14.961354 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 10:57:14.961354 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 10:57:14.961354 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 10:57:14.961354 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 10:57:14.961354 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application with Lock( Oct 13 10:57:14.961354 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 10:57:14.961354 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._enter() Oct 13 10:57:14.961354 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 10:57:14.961354 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 10:57:14.962141 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 10:57:14.962141 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.creator() Oct 13 10:57:14.962141 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 10:57:14.962141 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application created_value = creator( Oct 13 10:57:14.962141 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 13 10:57:14.962141 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 13 10:57:14.962141 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 13 10:57:14.962141 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 13 10:57:14.962141 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 13 10:57:14.962141 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 13 10:57:14.962141 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 13 10:57:14.962141 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application Oct 13 10:57:14.962141 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 36/67] 10.222.0.18 () {56 vars in 1099 bytes} [Thu Oct 13 10:57:14 2022] GET /identity/v3/roles/member => generated 84 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 10:57:14.962795 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69146676-8c58-4cd8-b4d6-b103e913357d None None] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:14.963048 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69146676-8c58-4cd8-b4d6-b103e913357d None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:14.963315 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69146676-8c58-4cd8-b4d6-b103e913357d None None] PATH_INFO: `/` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:14.965284 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 37/68] 10.222.0.18 () {54 vars in 927 bytes} [Thu Oct 13 10:57:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 10:57:14.965992 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69146676-8c58-4cd8-b4d6-b103e913357d None None] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:57:14.975256 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9699d88d-003c-4fb7-aa3a-57d5c902a3b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:57:14.975860 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9699d88d-003c-4fb7-aa3a-57d5c902a3b9 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:14.976142 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9699d88d-003c-4fb7-aa3a-57d5c902a3b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:14.976412 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9699d88d-003c-4fb7-aa3a-57d5c902a3b9 None admin] PATH_INFO: `/v3/roles` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:14.977114 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9699d88d-003c-4fb7-aa3a-57d5c902a3b9 None admin] RBAC: Adding query filter params (name=member) {{(pid=81534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 10:57:14.977421 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9699d88d-003c-4fb7-aa3a-57d5c902a3b9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:57:14.978810 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9699d88d-003c-4fb7-aa3a-57d5c902a3b9 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:57:14.991124 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 32/69] 10.222.0.18 () {56 vars in 1101 bytes} [Thu Oct 13 10:57:14 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 10:57:14.991920 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9699d88d-003c-4fb7-aa3a-57d5c902a3b9 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:57:15.019612 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:57:15.069544 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69146676-8c58-4cd8-b4d6-b103e913357d None None] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:57:15.091095 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9699d88d-003c-4fb7-aa3a-57d5c902a3b9 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:57:15.101956 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26e3cea-c04e-415d-b5ef-95350b0b9e49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:57:15.102603 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26e3cea-c04e-415d-b5ef-95350b0b9e49 None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:15.103156 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26e3cea-c04e-415d-b5ef-95350b0b9e49 None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:15.103433 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26e3cea-c04e-415d-b5ef-95350b0b9e49 None admin] PATH_INFO: `/v3/users/8ba31ade43694cf8bf28f7528a9ea179` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:15.104545 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26e3cea-c04e-415d-b5ef-95350b0b9e49 None admin] RBAC: Authorizing `identity:get_user(user_id=8ba31ade43694cf8bf28f7528a9ea179)` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:57:15.106014 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26e3cea-c04e-415d-b5ef-95350b0b9e49 None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:57:15.107566 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 38/70] 10.222.0.18 () {56 vars in 1177 bytes} [Thu Oct 13 10:57:14 2022] GET /identity/v3/users/8ba31ade43694cf8bf28f7528a9ea179 => generated 247 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 10:57:15.108317 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26e3cea-c04e-415d-b5ef-95350b0b9e49 None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:57:15.124309 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:57:15.124452 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41d7a02-088a-4936-972a-d54159ad2131 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:57:15.125089 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41d7a02-088a-4936-972a-d54159ad2131 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:15.125371 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41d7a02-088a-4936-972a-d54159ad2131 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:15.125771 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41d7a02-088a-4936-972a-d54159ad2131 None admin] PATH_INFO: `/v3/roles` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:15.126310 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41d7a02-088a-4936-972a-d54159ad2131 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 10:57:15.126614 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41d7a02-088a-4936-972a-d54159ad2131 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:57:15.127983 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41d7a02-088a-4936-972a-d54159ad2131 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:57:15.140998 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 33/71] 10.222.0.18 () {56 vars in 1111 bytes} [Thu Oct 13 10:57:14 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 10:57:15.140998 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1631ebb9-a194-4882-ab7f-2f1b7274aa6f None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:15.140998 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1631ebb9-a194-4882-ab7f-2f1b7274aa6f None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:15.140998 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1631ebb9-a194-4882-ab7f-2f1b7274aa6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:15.155719 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-1631ebb9-a194-4882-ab7f-2f1b7274aa6f None None] MFA Rules not processed for user `8ba31ade43694cf8bf28f7528a9ea179`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 10:57:15.156917 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-1631ebb9-a194-4882-ab7f-2f1b7274aa6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 10:57:15.211743 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26e3cea-c04e-415d-b5ef-95350b0b9e49 None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:57:15.224009 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 34/72] 10.222.0.18 () {58 vars in 1024 bytes} [Thu Oct 13 10:57:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 13 10:57:15.224844 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1631ebb9-a194-4882-ab7f-2f1b7274aa6f None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:57:15.246927 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acdfb626-1452-407f-ad9b-a4007c0e887c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:57:15.247534 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdfb626-1452-407f-ad9b-a4007c0e887c None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:15.247813 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdfb626-1452-407f-ad9b-a4007c0e887c None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:15.248090 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdfb626-1452-407f-ad9b-a4007c0e887c None admin] PATH_INFO: `/v3/roles` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:15.248756 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acdfb626-1452-407f-ad9b-a4007c0e887c None admin] RBAC: Adding query filter params (name=member) {{(pid=81533) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 10:57:15.249515 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acdfb626-1452-407f-ad9b-a4007c0e887c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:57:15.251288 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acdfb626-1452-407f-ad9b-a4007c0e887c None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:57:15.260004 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 39/73] 10.222.0.18 () {56 vars in 1101 bytes} [Thu Oct 13 10:57:15 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 10:57:15.260637 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acdfb626-1452-407f-ad9b-a4007c0e887c None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:57:15.268066 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:57:15.348512 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:57:15.361409 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1631ebb9-a194-4882-ab7f-2f1b7274aa6f None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:57:15.372784 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acdfb626-1452-407f-ad9b-a4007c0e887c None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:57:15.396701 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d9360e-3de4-4f0e-b42e-d886876d0f79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:57:15.397600 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d9360e-3de4-4f0e-b42e-d886876d0f79 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:15.398027 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d9360e-3de4-4f0e-b42e-d886876d0f79 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:15.398447 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d9360e-3de4-4f0e-b42e-d886876d0f79 None admin] PATH_INFO: `/v3/users/e6970c8c44f247bf84dac44daa2e7f44` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:15.406646 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b43a09-e689-4797-9361-0ba627310461 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:57:15.407276 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b43a09-e689-4797-9361-0ba627310461 None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:15.407557 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b43a09-e689-4797-9361-0ba627310461 None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:15.407831 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b43a09-e689-4797-9361-0ba627310461 None admin] PATH_INFO: `/v3/projects/8b052a27256842f098af78fca7334623` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:15.408968 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b43a09-e689-4797-9361-0ba627310461 None admin] RBAC: Authorizing `identity:get_project(project_id=8b052a27256842f098af78fca7334623)` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:57:15.410443 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b43a09-e689-4797-9361-0ba627310461 None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:57:15.412070 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 40/74] 10.222.0.18 () {56 vars in 1186 bytes} [Thu Oct 13 10:57:15 2022] GET /identity/v3/projects/8b052a27256842f098af78fca7334623 => generated 298 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 10:57:15.412825 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b43a09-e689-4797-9361-0ba627310461 None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:57:15.420665 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d9360e-3de4-4f0e-b42e-d886876d0f79 None admin] RBAC: Authorizing `identity:get_user(user_id=e6970c8c44f247bf84dac44daa2e7f44)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:57:15.422431 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d9360e-3de4-4f0e-b42e-d886876d0f79 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:57:15.424243 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 35/75] 10.222.0.18 () {56 vars in 1177 bytes} [Thu Oct 13 10:57:15 2022] GET /identity/v3/users/e6970c8c44f247bf84dac44daa2e7f44 => generated 275 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 10:57:15.429474 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d9360e-3de4-4f0e-b42e-d886876d0f79 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:57:15.516697 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:57:15.523359 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b43a09-e689-4797-9361-0ba627310461 None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:57:15.539587 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d9360e-3de4-4f0e-b42e-d886876d0f79 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:57:15.556411 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623085ac-e6e4-4dc9-801f-396ac2348a92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:57:15.557058 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623085ac-e6e4-4dc9-801f-396ac2348a92 None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:15.557344 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623085ac-e6e4-4dc9-801f-396ac2348a92 None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:15.558202 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623085ac-e6e4-4dc9-801f-396ac2348a92 None admin] PATH_INFO: `/v3/users/e6970c8c44f247bf84dac44daa2e7f44` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:15.559376 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623085ac-e6e4-4dc9-801f-396ac2348a92 None admin] RBAC: Authorizing `identity:get_user(user_id=e6970c8c44f247bf84dac44daa2e7f44)` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:57:15.560816 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623085ac-e6e4-4dc9-801f-396ac2348a92 None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:57:15.562436 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 41/76] 10.222.0.18 () {56 vars in 1177 bytes} [Thu Oct 13 10:57:15 2022] GET /identity/v3/users/e6970c8c44f247bf84dac44daa2e7f44 => generated 275 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 10:57:15.563171 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623085ac-e6e4-4dc9-801f-396ac2348a92 None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:57:15.577469 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:57:15.579789 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09770538-fd47-42ba-b33d-4a87f54ce834 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:57:15.580403 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09770538-fd47-42ba-b33d-4a87f54ce834 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:15.580684 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09770538-fd47-42ba-b33d-4a87f54ce834 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:15.580956 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09770538-fd47-42ba-b33d-4a87f54ce834 None admin] PATH_INFO: `/v3/users/e6970c8c44f247bf84dac44daa2e7f44` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:15.582245 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09770538-fd47-42ba-b33d-4a87f54ce834 None admin] RBAC: Authorizing `identity:get_user(user_id=e6970c8c44f247bf84dac44daa2e7f44)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:57:15.583568 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09770538-fd47-42ba-b33d-4a87f54ce834 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:57:15.585171 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 36/77] 10.222.0.18 () {56 vars in 1177 bytes} [Thu Oct 13 10:57:15 2022] GET /identity/v3/users/e6970c8c44f247bf84dac44daa2e7f44 => generated 275 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 10:57:15.585926 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09770538-fd47-42ba-b33d-4a87f54ce834 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:57:15.663845 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623085ac-e6e4-4dc9-801f-396ac2348a92 None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:57:15.685419 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09770538-fd47-42ba-b33d-4a87f54ce834 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:57:15.696270 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed255292-0c06-4a91-b040-37aa1c48fc2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:57:15.696926 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed255292-0c06-4a91-b040-37aa1c48fc2b None admin] REQUEST_METHOD: `PUT` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:15.697233 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed255292-0c06-4a91-b040-37aa1c48fc2b None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:15.697507 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed255292-0c06-4a91-b040-37aa1c48fc2b None admin] PATH_INFO: `/v3/projects/8b052a27256842f098af78fca7334623/users/8ba31ade43694cf8bf28f7528a9ea179/roles/30a6d59262144d4d956f4d4207864030` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:15.699988 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed255292-0c06-4a91-b040-37aa1c48fc2b None admin] RBAC: Authorizing `identity:create_grant(project_id=8b052a27256842f098af78fca7334623, user_id=8ba31ade43694cf8bf28f7528a9ea179, role_id=30a6d59262144d4d956f4d4207864030)` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:57:15.701455 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed255292-0c06-4a91-b040-37aa1c48fc2b None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:57:15.714017 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 42/78] 10.222.0.18 () {58 vars in 1439 bytes} [Thu Oct 13 10:57:15 2022] PUT /identity/v3/projects/8b052a27256842f098af78fca7334623/users/8ba31ade43694cf8bf28f7528a9ea179/roles/30a6d59262144d4d956f4d4207864030 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 10:57:15.714894 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed255292-0c06-4a91-b040-37aa1c48fc2b None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:57:15.739451 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76bb5e2a-fd4e-46d1-a7f3-7b8af95297ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:57:15.740276 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bb5e2a-fd4e-46d1-a7f3-7b8af95297ab None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:15.740580 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bb5e2a-fd4e-46d1-a7f3-7b8af95297ab None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:15.740831 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bb5e2a-fd4e-46d1-a7f3-7b8af95297ab None admin] PATH_INFO: `/v3/projects/8b052a27256842f098af78fca7334623` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:15.742756 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76bb5e2a-fd4e-46d1-a7f3-7b8af95297ab None admin] RBAC: Authorizing `identity:get_project(project_id=8b052a27256842f098af78fca7334623)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:57:15.744261 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76bb5e2a-fd4e-46d1-a7f3-7b8af95297ab None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:57:15.749232 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 37/79] 10.222.0.18 () {56 vars in 1186 bytes} [Thu Oct 13 10:57:15 2022] GET /identity/v3/projects/8b052a27256842f098af78fca7334623 => generated 298 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 10:57:15.749232 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76bb5e2a-fd4e-46d1-a7f3-7b8af95297ab None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:57:15.771741 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:57:15.802002 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:57:15.839925 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed255292-0c06-4a91-b040-37aa1c48fc2b None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:57:15.871482 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76bb5e2a-fd4e-46d1-a7f3-7b8af95297ab None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:57:15.887203 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea617c1-a1d7-4ddd-b06a-6882ae510e18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:57:15.888535 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea617c1-a1d7-4ddd-b06a-6882ae510e18 None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:15.888814 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea617c1-a1d7-4ddd-b06a-6882ae510e18 None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:15.889883 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea617c1-a1d7-4ddd-b06a-6882ae510e18 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:15.890300 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea617c1-a1d7-4ddd-b06a-6882ae510e18 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:57:15.891737 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea617c1-a1d7-4ddd-b06a-6882ae510e18 None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:57:15.893349 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 43/80] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Oct 13 10:57:15 2022] GET /identity/v3/domains/default => generated 199 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 10:57:15.897812 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea617c1-a1d7-4ddd-b06a-6882ae510e18 None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:57:15.911054 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d50a3f-b0d4-4aca-8c24-3b961191fa3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:57:15.911692 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d50a3f-b0d4-4aca-8c24-3b961191fa3b None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:15.911973 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d50a3f-b0d4-4aca-8c24-3b961191fa3b None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:15.912245 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d50a3f-b0d4-4aca-8c24-3b961191fa3b None admin] PATH_INFO: `/v3/projects/8b052a27256842f098af78fca7334623` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:15.913430 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d50a3f-b0d4-4aca-8c24-3b961191fa3b None admin] RBAC: Authorizing `identity:get_project(project_id=8b052a27256842f098af78fca7334623)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:57:15.914914 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d50a3f-b0d4-4aca-8c24-3b961191fa3b None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:57:15.916498 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 38/81] 10.222.0.18 () {56 vars in 1186 bytes} [Thu Oct 13 10:57:15 2022] GET /identity/v3/projects/8b052a27256842f098af78fca7334623 => generated 298 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 10:57:15.917388 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d50a3f-b0d4-4aca-8c24-3b961191fa3b None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:57:16.008586 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:57:16.020297 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea617c1-a1d7-4ddd-b06a-6882ae510e18 None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:57:16.029877 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d50a3f-b0d4-4aca-8c24-3b961191fa3b None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:57:16.061869 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140b5744-49d2-46d2-b7aa-d5b2c48aa826 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:57:16.062788 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140b5744-49d2-46d2-b7aa-d5b2c48aa826 None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:16.063253 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140b5744-49d2-46d2-b7aa-d5b2c48aa826 None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:16.063592 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140b5744-49d2-46d2-b7aa-d5b2c48aa826 None admin] PATH_INFO: `/v3/projects/321d311de3ab42a7a6285fcf0f3c0968` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:16.064558 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e681911d-34ad-4a00-af6e-27f6bee00f0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:57:16.064742 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140b5744-49d2-46d2-b7aa-d5b2c48aa826 None admin] RBAC: Authorizing `identity:get_project(project_id=321d311de3ab42a7a6285fcf0f3c0968)` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:57:16.065259 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e681911d-34ad-4a00-af6e-27f6bee00f0e None admin] REQUEST_METHOD: `PUT` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:16.065546 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e681911d-34ad-4a00-af6e-27f6bee00f0e None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:16.065822 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e681911d-34ad-4a00-af6e-27f6bee00f0e None admin] PATH_INFO: `/v3/projects/8b052a27256842f098af78fca7334623/users/e6970c8c44f247bf84dac44daa2e7f44/roles/a893cd4f751e445aab4dda1a832f24a1` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:16.066183 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140b5744-49d2-46d2-b7aa-d5b2c48aa826 None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:57:16.072561 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 44/82] 10.222.0.18 () {56 vars in 1186 bytes} [Thu Oct 13 10:57:15 2022] GET /identity/v3/projects/321d311de3ab42a7a6285fcf0f3c0968 => generated 312 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 10:57:16.072697 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e681911d-34ad-4a00-af6e-27f6bee00f0e None admin] RBAC: Authorizing `identity:create_grant(project_id=8b052a27256842f098af78fca7334623, user_id=e6970c8c44f247bf84dac44daa2e7f44, role_id=a893cd4f751e445aab4dda1a832f24a1)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:57:16.072777 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140b5744-49d2-46d2-b7aa-d5b2c48aa826 None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:57:16.072857 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e681911d-34ad-4a00-af6e-27f6bee00f0e None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:57:16.084526 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 39/83] 10.222.0.18 () {58 vars in 1439 bytes} [Thu Oct 13 10:57:15 2022] PUT /identity/v3/projects/8b052a27256842f098af78fca7334623/users/e6970c8c44f247bf84dac44daa2e7f44/roles/a893cd4f751e445aab4dda1a832f24a1 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 10:57:16.093240 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e681911d-34ad-4a00-af6e-27f6bee00f0e None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:57:16.097403 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:57:16.230167 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140b5744-49d2-46d2-b7aa-d5b2c48aa826 None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:57:16.230829 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e681911d-34ad-4a00-af6e-27f6bee00f0e None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:57:16.269454 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ad3bb3-62a7-4c60-b4a3-45e7c84904af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:57:16.270100 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ad3bb3-62a7-4c60-b4a3-45e7c84904af None admin] REQUEST_METHOD: `POST` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:16.270379 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ad3bb3-62a7-4c60-b4a3-45e7c84904af None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:16.270651 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ad3bb3-62a7-4c60-b4a3-45e7c84904af None admin] PATH_INFO: `/v3/users` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:16.270969 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9b83c1-2da7-4a14-bf56-30abd97e6cec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:57:16.271314 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ad3bb3-62a7-4c60-b4a3-45e7c84904af None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:57:16.272099 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9b83c1-2da7-4a14-bf56-30abd97e6cec None admin] REQUEST_METHOD: `PUT` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:16.272386 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9b83c1-2da7-4a14-bf56-30abd97e6cec None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:16.272666 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9b83c1-2da7-4a14-bf56-30abd97e6cec None admin] PATH_INFO: `/v3/projects/8b052a27256842f098af78fca7334623/users/e6970c8c44f247bf84dac44daa2e7f44/roles/e49be8727cbd4a39b3fbe6925f5af415` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:16.273911 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ad3bb3-62a7-4c60-b4a3-45e7c84904af None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:57:16.275894 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9b83c1-2da7-4a14-bf56-30abd97e6cec None admin] RBAC: Authorizing `identity:create_grant(project_id=8b052a27256842f098af78fca7334623, user_id=e6970c8c44f247bf84dac44daa2e7f44, role_id=e49be8727cbd4a39b3fbe6925f5af415)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:57:16.278181 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9b83c1-2da7-4a14-bf56-30abd97e6cec None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:57:16.293997 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 40/84] 10.222.0.18 () {58 vars in 1439 bytes} [Thu Oct 13 10:57:16 2022] PUT /identity/v3/projects/8b052a27256842f098af78fca7334623/users/e6970c8c44f247bf84dac44daa2e7f44/roles/e49be8727cbd4a39b3fbe6925f5af415 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 10:57:16.294779 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9b83c1-2da7-4a14-bf56-30abd97e6cec None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:57:16.298898 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:57:16.329049 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 45/85] 10.222.0.18 () {60 vars in 1132 bytes} [Thu Oct 13 10:57:16 2022] POST /identity/v3/users => generated 289 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 13 10:57:16.472237 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9b83c1-2da7-4a14-bf56-30abd97e6cec None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:57:16.527809 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7e61e4-c5be-4b4c-8028-a3d465e45726 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:57:16.528414 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7e61e4-c5be-4b4c-8028-a3d465e45726 None admin] REQUEST_METHOD: `PUT` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:16.528705 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7e61e4-c5be-4b4c-8028-a3d465e45726 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:16.528984 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7e61e4-c5be-4b4c-8028-a3d465e45726 None admin] PATH_INFO: `/v3/projects/321d311de3ab42a7a6285fcf0f3c0968/users/e6970c8c44f247bf84dac44daa2e7f44/roles/a893cd4f751e445aab4dda1a832f24a1` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:16.534669 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7e61e4-c5be-4b4c-8028-a3d465e45726 None admin] RBAC: Authorizing `identity:create_grant(project_id=321d311de3ab42a7a6285fcf0f3c0968, user_id=e6970c8c44f247bf84dac44daa2e7f44, role_id=a893cd4f751e445aab4dda1a832f24a1)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:57:16.536163 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7e61e4-c5be-4b4c-8028-a3d465e45726 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:57:16.564540 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 41/86] 10.222.0.18 () {58 vars in 1439 bytes} [Thu Oct 13 10:57:16 2022] PUT /identity/v3/projects/321d311de3ab42a7a6285fcf0f3c0968/users/e6970c8c44f247bf84dac44daa2e7f44/roles/a893cd4f751e445aab4dda1a832f24a1 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 10:57:18.511748 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398dd3b3-c1d4-46b5-bb61-a9556c9d6fdf None None] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:18.512297 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398dd3b3-c1d4-46b5-bb61-a9556c9d6fdf None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:18.512297 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398dd3b3-c1d4-46b5-bb61-a9556c9d6fdf None None] PATH_INFO: `/` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:18.513962 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 46/87] 10.222.0.18 () {54 vars in 927 bytes} [Thu Oct 13 10:57:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 10:57:18.519193 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf57b3d-46ef-40fe-8882-48e7f38d27b0 None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:18.519582 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf57b3d-46ef-40fe-8882-48e7f38d27b0 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:18.519759 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf57b3d-46ef-40fe-8882-48e7f38d27b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:18.543184 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-3bf57b3d-46ef-40fe-8882-48e7f38d27b0 None None] MFA Rules not processed for user `8ba31ade43694cf8bf28f7528a9ea179`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 10:57:18.544487 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-3bf57b3d-46ef-40fe-8882-48e7f38d27b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 10:57:18.602707 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:57:18.615628 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 42/88] 10.222.0.18 () {58 vars in 1024 bytes} [Thu Oct 13 10:57:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 13 10:57:19.171274 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398dd3b3-c1d4-46b5-bb61-a9556c9d6fdf None None] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:57:19.253072 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:57:19.307254 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398dd3b3-c1d4-46b5-bb61-a9556c9d6fdf None None] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:57:19.352507 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22fdcd2c-6fac-4244-b9a9-eb6d5d5c7004 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:57:19.353188 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fdcd2c-6fac-4244-b9a9-eb6d5d5c7004 None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:19.353466 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fdcd2c-6fac-4244-b9a9-eb6d5d5c7004 None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:19.353742 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fdcd2c-6fac-4244-b9a9-eb6d5d5c7004 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:19.369862 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22fdcd2c-6fac-4244-b9a9-eb6d5d5c7004 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 13 10:57:19.375315 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application [None req-22fdcd2c-6fac-4244-b9a9-eb6d5d5c7004 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 13 10:57:19.375315 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 10:57:19.375315 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 10:57:19.375315 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 10:57:19.375315 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 10:57:19.375315 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 10:57:19.375315 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 10:57:19.375315 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 10:57:19.375315 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 10:57:19.375315 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 10:57:19.375315 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 10:57:19.375315 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 10:57:19.375315 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 13 10:57:19.375315 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 13 10:57:19.375315 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 13 10:57:19.375315 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 13 10:57:19.376364 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 13 10:57:19.376364 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 13 10:57:19.376364 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 13 10:57:19.376364 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 13 10:57:19.376364 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 10:57:19.376364 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 10:57:19.376364 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 10:57:19.376364 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 10:57:19.376364 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 10:57:19.376364 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 10:57:19.376364 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 10:57:19.376364 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application with Lock( Oct 13 10:57:19.376364 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 10:57:19.376364 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._enter() Oct 13 10:57:19.376364 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 10:57:19.376364 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 10:57:19.377315 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 10:57:19.377315 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.creator() Oct 13 10:57:19.377315 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 10:57:19.377315 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application created_value = creator( Oct 13 10:57:19.377315 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 13 10:57:19.377315 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 13 10:57:19.377315 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 13 10:57:19.377315 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 13 10:57:19.377315 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 13 10:57:19.377315 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 13 10:57:19.377315 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 13 10:57:19.377315 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application Oct 13 10:57:19.377989 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 47/89] 10.222.0.18 () {56 vars in 1096 bytes} [Thu Oct 13 10:57:19 2022] GET /identity/v3/roles/admin => generated 83 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 10:57:19.382801 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf57b3d-46ef-40fe-8882-48e7f38d27b0 None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:57:19.456406 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78e2bcb-2594-4854-905f-f2212a2a6119 None None] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:19.456994 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78e2bcb-2594-4854-905f-f2212a2a6119 None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:19.457481 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78e2bcb-2594-4854-905f-f2212a2a6119 None None] PATH_INFO: `/` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:19.459602 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 48/90] 10.222.0.18 () {54 vars in 927 bytes} [Thu Oct 13 10:57:19 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 13 10:57:19.466623 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1607786e-72f0-45aa-92b1-c0dc09750d28 None None] REQUEST_METHOD: `POST` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:19.467337 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1607786e-72f0-45aa-92b1-c0dc09750d28 None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:19.467924 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1607786e-72f0-45aa-92b1-c0dc09750d28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:19.497605 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.auth.core [None req-1607786e-72f0-45aa-92b1-c0dc09750d28 None None] MFA Rules not processed for user `8ba31ade43694cf8bf28f7528a9ea179`. Rule list: `[]` (Enabled: `True`). {{(pid=81533) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 10:57:19.499473 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-1607786e-72f0-45aa-92b1-c0dc09750d28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 10:57:19.571584 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf57b3d-46ef-40fe-8882-48e7f38d27b0 None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:57:19.627892 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 49/91] 10.222.0.18 () {58 vars in 1024 bytes} [Thu Oct 13 10:57:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 13 10:57:19.629570 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0349f89-badb-4b9a-92b8-39b8908ff11c None None] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:19.629857 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0349f89-badb-4b9a-92b8-39b8908ff11c None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:19.630132 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0349f89-badb-4b9a-92b8-39b8908ff11c None None] PATH_INFO: `/` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:19.631866 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 50/92] 10.222.0.18 () {54 vars in 927 bytes} [Thu Oct 13 10:57:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 10:57:19.644402 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5b84c4-7b62-43e8-aa6c-f8aa6c1e7395 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:57:19.645052 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5b84c4-7b62-43e8-aa6c-f8aa6c1e7395 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:19.645322 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5b84c4-7b62-43e8-aa6c-f8aa6c1e7395 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:19.645592 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5b84c4-7b62-43e8-aa6c-f8aa6c1e7395 None admin] PATH_INFO: `/v3/roles` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:19.646260 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5b84c4-7b62-43e8-aa6c-f8aa6c1e7395 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 10:57:19.646558 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5b84c4-7b62-43e8-aa6c-f8aa6c1e7395 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:57:19.647952 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5b84c4-7b62-43e8-aa6c-f8aa6c1e7395 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:57:19.650901 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e50ff11-fcac-42aa-b632-ddb4102898f1 None None] REQUEST_METHOD: `POST` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:19.651748 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e50ff11-fcac-42aa-b632-ddb4102898f1 None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:19.652159 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e50ff11-fcac-42aa-b632-ddb4102898f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:19.672542 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 43/93] 10.222.0.18 () {56 vars in 1099 bytes} [Thu Oct 13 10:57:19 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 10:57:19.672719 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.auth.core [None req-1e50ff11-fcac-42aa-b632-ddb4102898f1 None None] MFA Rules not processed for user `8ba31ade43694cf8bf28f7528a9ea179`. Rule list: `[]` (Enabled: `True`). {{(pid=81533) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 10:57:19.673902 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-1e50ff11-fcac-42aa-b632-ddb4102898f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 10:57:19.674008 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5072267-3e6f-4a56-9802-e018ea38eff7 None None] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:19.674253 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5072267-3e6f-4a56-9802-e018ea38eff7 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:19.674536 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5072267-3e6f-4a56-9802-e018ea38eff7 None None] PATH_INFO: `/` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:19.682993 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 44/94] 10.222.0.18 () {54 vars in 927 bytes} [Thu Oct 13 10:57:19 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 10:57:19.686232 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5072267-3e6f-4a56-9802-e018ea38eff7 None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:57:19.779055 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:57:19.805868 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:57:19.816976 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 51/95] 10.222.0.18 () {58 vars in 1024 bytes} [Thu Oct 13 10:57:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 13 10:57:19.820156 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db602618-4ee6-40b8-9a17-173fb5333273 None None] REQUEST_METHOD: `POST` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:19.820461 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db602618-4ee6-40b8-9a17-173fb5333273 None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:19.820705 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db602618-4ee6-40b8-9a17-173fb5333273 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:19.866409 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.auth.core [None req-db602618-4ee6-40b8-9a17-173fb5333273 None None] MFA Rules not processed for user `8ba31ade43694cf8bf28f7528a9ea179`. Rule list: `[]` (Enabled: `True`). {{(pid=81533) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 10:57:19.867608 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-db602618-4ee6-40b8-9a17-173fb5333273 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 10:57:19.908815 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5072267-3e6f-4a56-9802-e018ea38eff7 None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:57:19.956041 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdbda426-f1ca-4420-8646-99a81601cbff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:57:19.957075 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbda426-f1ca-4420-8646-99a81601cbff None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:19.957677 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbda426-f1ca-4420-8646-99a81601cbff None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:19.958196 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbda426-f1ca-4420-8646-99a81601cbff None admin] PATH_INFO: `/v3/users/8ba31ade43694cf8bf28f7528a9ea179` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:19.962783 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 52/96] 10.222.0.18 () {58 vars in 1024 bytes} [Thu Oct 13 10:57:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 13 10:57:19.963666 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdbda426-f1ca-4420-8646-99a81601cbff None admin] RBAC: Authorizing `identity:get_user(user_id=8ba31ade43694cf8bf28f7528a9ea179)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:57:19.965654 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdbda426-f1ca-4420-8646-99a81601cbff None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:57:19.967441 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 45/97] 10.222.0.18 () {56 vars in 1177 bytes} [Thu Oct 13 10:57:19 2022] GET /identity/v3/users/8ba31ade43694cf8bf28f7528a9ea179 => generated 247 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 10:57:19.972774 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db602618-4ee6-40b8-9a17-173fb5333273 None None] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:57:19.974500 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a36450-bc1c-4bec-9328-46fe64ed807b None None] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:19.974786 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a36450-bc1c-4bec-9328-46fe64ed807b None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:19.975050 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a36450-bc1c-4bec-9328-46fe64ed807b None None] PATH_INFO: `/` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:19.976589 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 46/98] 10.222.0.18 () {54 vars in 927 bytes} [Thu Oct 13 10:57:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 10:57:19.987839 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411550c5-c09f-40ea-8783-e2a2bbca13ea None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:19.988093 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411550c5-c09f-40ea-8783-e2a2bbca13ea None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:19.988330 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411550c5-c09f-40ea-8783-e2a2bbca13ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:20.017842 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-411550c5-c09f-40ea-8783-e2a2bbca13ea None None] MFA Rules not processed for user `8ba31ade43694cf8bf28f7528a9ea179`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 10:57:20.020207 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-411550c5-c09f-40ea-8783-e2a2bbca13ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 10:57:20.103076 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 47/99] 10.222.0.18 () {58 vars in 1024 bytes} [Thu Oct 13 10:57:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 13 10:57:20.104018 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411550c5-c09f-40ea-8783-e2a2bbca13ea None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:57:20.171873 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db602618-4ee6-40b8-9a17-173fb5333273 None None] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:57:20.191538 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:57:20.199876 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:57:20.221476 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6987c97c-ebb3-4a1d-87f0-49c9b9b9713b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:57:20.222090 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6987c97c-ebb3-4a1d-87f0-49c9b9b9713b None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:20.222375 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6987c97c-ebb3-4a1d-87f0-49c9b9b9713b None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:20.222654 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6987c97c-ebb3-4a1d-87f0-49c9b9b9713b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:20.281941 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411550c5-c09f-40ea-8783-e2a2bbca13ea None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:57:20.295220 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6987c97c-ebb3-4a1d-87f0-49c9b9b9713b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:57:20.296691 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6987c97c-ebb3-4a1d-87f0-49c9b9b9713b None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:57:20.322509 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b190b13d-3add-4a09-a07f-1e07000c4dac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:57:20.323245 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b190b13d-3add-4a09-a07f-1e07000c4dac None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:20.323531 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b190b13d-3add-4a09-a07f-1e07000c4dac None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:20.323864 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b190b13d-3add-4a09-a07f-1e07000c4dac None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:20.334271 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b190b13d-3add-4a09-a07f-1e07000c4dac None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 13 10:57:20.339814 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application [None req-b190b13d-3add-4a09-a07f-1e07000c4dac None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 13 10:57:20.339814 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 10:57:20.339814 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 10:57:20.339814 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 10:57:20.339814 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 10:57:20.339814 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 10:57:20.339814 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 10:57:20.339814 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 10:57:20.339814 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 10:57:20.339814 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 10:57:20.339814 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 10:57:20.339814 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 10:57:20.339814 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 13 10:57:20.339814 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 13 10:57:20.339814 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 13 10:57:20.339814 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 13 10:57:20.340679 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 13 10:57:20.340679 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 13 10:57:20.340679 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 13 10:57:20.340679 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 13 10:57:20.340679 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 10:57:20.340679 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 10:57:20.340679 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 10:57:20.340679 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 10:57:20.340679 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 10:57:20.340679 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 10:57:20.340679 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 10:57:20.340679 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application with Lock( Oct 13 10:57:20.340679 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 10:57:20.340679 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._enter() Oct 13 10:57:20.340679 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 10:57:20.340679 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 10:57:20.345704 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 10:57:20.345704 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.creator() Oct 13 10:57:20.345704 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 10:57:20.345704 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application created_value = creator( Oct 13 10:57:20.345704 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 13 10:57:20.345704 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 13 10:57:20.345704 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 13 10:57:20.345704 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 13 10:57:20.345704 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 13 10:57:20.345704 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 13 10:57:20.345704 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 13 10:57:20.345704 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application Oct 13 10:57:20.345704 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 48/100] 10.222.0.18 () {56 vars in 1114 bytes} [Thu Oct 13 10:57:20 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 10:57:20.345704 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff30e54-df35-46b5-8f2a-44a788f24a2c None None] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:20.346489 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff30e54-df35-46b5-8f2a-44a788f24a2c None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:20.346489 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff30e54-df35-46b5-8f2a-44a788f24a2c None None] PATH_INFO: `/` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:20.346489 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 49/101] 10.222.0.18 () {54 vars in 927 bytes} [Thu Oct 13 10:57:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 10:57:20.346489 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff30e54-df35-46b5-8f2a-44a788f24a2c None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:57:20.407411 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 53/102] 10.222.0.18 () {58 vars in 1282 bytes} [Thu Oct 13 10:57:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 435 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 13 10:57:20.412551 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6987c97c-ebb3-4a1d-87f0-49c9b9b9713b None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:57:20.427979 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:57:20.453820 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff30e54-df35-46b5-8f2a-44a788f24a2c None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:57:20.466891 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:57:20.489096 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316b26b1-9d0d-4a07-93a5-59d3855065fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:57:20.489732 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316b26b1-9d0d-4a07-93a5-59d3855065fb None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:20.490010 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316b26b1-9d0d-4a07-93a5-59d3855065fb None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:20.490281 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316b26b1-9d0d-4a07-93a5-59d3855065fb None admin] PATH_INFO: `/v3/roles/member` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:20.501055 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316b26b1-9d0d-4a07-93a5-59d3855065fb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 13 10:57:20.505856 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application [None req-316b26b1-9d0d-4a07-93a5-59d3855065fb None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 13 10:57:20.505856 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 10:57:20.505856 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 10:57:20.505856 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 10:57:20.505856 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 10:57:20.505856 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 10:57:20.505856 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 10:57:20.505856 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 10:57:20.505856 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 10:57:20.505856 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 10:57:20.505856 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 10:57:20.505856 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 10:57:20.505856 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 13 10:57:20.505856 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 13 10:57:20.505856 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 13 10:57:20.505856 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 13 10:57:20.506901 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 13 10:57:20.506901 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 13 10:57:20.506901 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 13 10:57:20.506901 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 13 10:57:20.506901 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 10:57:20.506901 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 10:57:20.506901 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 10:57:20.506901 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 10:57:20.506901 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 10:57:20.506901 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 10:57:20.506901 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 10:57:20.506901 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application with Lock( Oct 13 10:57:20.506901 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 10:57:20.506901 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._enter() Oct 13 10:57:20.506901 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 10:57:20.506901 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 10:57:20.508118 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 10:57:20.508118 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.creator() Oct 13 10:57:20.508118 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 10:57:20.508118 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application created_value = creator( Oct 13 10:57:20.508118 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 13 10:57:20.508118 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 13 10:57:20.508118 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 13 10:57:20.508118 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 13 10:57:20.508118 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 13 10:57:20.508118 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 13 10:57:20.508118 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 13 10:57:20.508118 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application Oct 13 10:57:20.508118 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 50/103] 10.222.0.18 () {56 vars in 1099 bytes} [Thu Oct 13 10:57:20 2022] GET /identity/v3/roles/member => generated 84 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 10:57:20.508916 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79394cfb-d13d-466c-a4f4-709b37448867 None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:20.508916 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79394cfb-d13d-466c-a4f4-709b37448867 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:20.508916 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79394cfb-d13d-466c-a4f4-709b37448867 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:20.519990 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6987c97c-ebb3-4a1d-87f0-49c9b9b9713b None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:57:20.526725 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-79394cfb-d13d-466c-a4f4-709b37448867 None None] MFA Rules not processed for user `8ba31ade43694cf8bf28f7528a9ea179`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 10:57:20.527923 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-79394cfb-d13d-466c-a4f4-709b37448867 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 10:57:20.552895 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26530bc-f4dc-4f20-ab7f-d9485047b917 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:57:20.553486 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26530bc-f4dc-4f20-ab7f-d9485047b917 None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:20.553761 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26530bc-f4dc-4f20-ab7f-d9485047b917 None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:20.554033 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26530bc-f4dc-4f20-ab7f-d9485047b917 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:20.564610 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26530bc-f4dc-4f20-ab7f-d9485047b917 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 13 10:57:20.569398 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application [None req-d26530bc-f4dc-4f20-ab7f-d9485047b917 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 13 10:57:20.569398 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 10:57:20.569398 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 10:57:20.569398 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 10:57:20.569398 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 10:57:20.569398 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 10:57:20.569398 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 10:57:20.569398 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 10:57:20.569398 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 10:57:20.569398 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 10:57:20.569398 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 10:57:20.569398 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 10:57:20.569398 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 13 10:57:20.569398 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 13 10:57:20.569398 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 13 10:57:20.569398 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 13 10:57:20.570262 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 13 10:57:20.570262 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 13 10:57:20.570262 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 13 10:57:20.570262 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 13 10:57:20.570262 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 10:57:20.570262 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 10:57:20.570262 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 10:57:20.570262 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 10:57:20.570262 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 10:57:20.570262 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 10:57:20.570262 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 10:57:20.570262 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application with Lock( Oct 13 10:57:20.570262 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 10:57:20.570262 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._enter() Oct 13 10:57:20.570262 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 10:57:20.570262 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 10:57:20.571054 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 10:57:20.571054 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.creator() Oct 13 10:57:20.571054 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 10:57:20.571054 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application created_value = creator( Oct 13 10:57:20.571054 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 13 10:57:20.571054 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 13 10:57:20.571054 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 13 10:57:20.571054 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 13 10:57:20.571054 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 13 10:57:20.571054 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 13 10:57:20.571054 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 13 10:57:20.571054 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application Oct 13 10:57:20.571054 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 54/104] 10.222.0.18 () {56 vars in 1099 bytes} [Thu Oct 13 10:57:20 2022] GET /identity/v3/roles/reader => generated 84 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 10:57:20.572695 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26530bc-f4dc-4f20-ab7f-d9485047b917 None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:57:20.594332 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 51/105] 10.222.0.18 () {58 vars in 1024 bytes} [Thu Oct 13 10:57:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 13 10:57:20.595168 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79394cfb-d13d-466c-a4f4-709b37448867 None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:57:20.657498 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:57:20.683578 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26530bc-f4dc-4f20-ab7f-d9485047b917 None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:57:20.702223 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79394cfb-d13d-466c-a4f4-709b37448867 None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:57:20.703893 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:57:20.722706 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060ec4a5-ff42-4ca8-9971-7bfba35e2fbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:57:20.723341 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060ec4a5-ff42-4ca8-9971-7bfba35e2fbb None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:20.723616 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060ec4a5-ff42-4ca8-9971-7bfba35e2fbb None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:20.723888 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060ec4a5-ff42-4ca8-9971-7bfba35e2fbb None admin] PATH_INFO: `/v3/roles` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:20.724625 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060ec4a5-ff42-4ca8-9971-7bfba35e2fbb None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81533) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 10:57:20.724924 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060ec4a5-ff42-4ca8-9971-7bfba35e2fbb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:57:20.726349 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060ec4a5-ff42-4ca8-9971-7bfba35e2fbb None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:57:20.736607 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 55/106] 10.222.0.18 () {56 vars in 1111 bytes} [Thu Oct 13 10:57:20 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 10:57:20.737323 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060ec4a5-ff42-4ca8-9971-7bfba35e2fbb None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:57:20.748219 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5ac479-1a82-482c-8010-07e23c897293 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:57:20.748852 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5ac479-1a82-482c-8010-07e23c897293 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:20.749159 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5ac479-1a82-482c-8010-07e23c897293 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:20.749435 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5ac479-1a82-482c-8010-07e23c897293 None admin] PATH_INFO: `/v3/projects/8b052a27256842f098af78fca7334623` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:20.750547 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c5ac479-1a82-482c-8010-07e23c897293 None admin] RBAC: Authorizing `identity:get_project(project_id=8b052a27256842f098af78fca7334623)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:57:20.752392 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c5ac479-1a82-482c-8010-07e23c897293 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:57:20.759036 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 52/107] 10.222.0.18 () {56 vars in 1186 bytes} [Thu Oct 13 10:57:20 2022] GET /identity/v3/projects/8b052a27256842f098af78fca7334623 => generated 298 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 10:57:20.759036 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5ac479-1a82-482c-8010-07e23c897293 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:57:20.843754 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060ec4a5-ff42-4ca8-9971-7bfba35e2fbb None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:57:20.868224 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5ac479-1a82-482c-8010-07e23c897293 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:57:20.877566 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc26c448-4e57-43c4-896e-38196b2aa347 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:57:20.878197 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc26c448-4e57-43c4-896e-38196b2aa347 None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:20.878473 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc26c448-4e57-43c4-896e-38196b2aa347 None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:20.878744 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc26c448-4e57-43c4-896e-38196b2aa347 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:20.881337 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:57:20.890240 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc26c448-4e57-43c4-896e-38196b2aa347 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 13 10:57:20.895659 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application [None req-cc26c448-4e57-43c4-896e-38196b2aa347 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 13 10:57:20.895659 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 10:57:20.895659 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 10:57:20.895659 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 10:57:20.895659 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 10:57:20.895659 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 10:57:20.895659 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 10:57:20.895659 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 10:57:20.895659 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 10:57:20.895659 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 10:57:20.895659 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 10:57:20.895659 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 10:57:20.895659 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 13 10:57:20.895659 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 13 10:57:20.895659 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 13 10:57:20.895659 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 13 10:57:20.896578 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 13 10:57:20.896578 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 13 10:57:20.896578 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 13 10:57:20.896578 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 13 10:57:20.896578 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 10:57:20.896578 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 10:57:20.896578 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 10:57:20.896578 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 10:57:20.896578 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 10:57:20.896578 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 10:57:20.896578 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 10:57:20.896578 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application with Lock( Oct 13 10:57:20.896578 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 10:57:20.896578 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._enter() Oct 13 10:57:20.896578 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 10:57:20.896578 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 10:57:20.897407 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 10:57:20.897407 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.creator() Oct 13 10:57:20.897407 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 10:57:20.897407 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application created_value = creator( Oct 13 10:57:20.897407 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 13 10:57:20.897407 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 13 10:57:20.897407 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 13 10:57:20.897407 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 13 10:57:20.897407 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 13 10:57:20.897407 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 13 10:57:20.897407 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 13 10:57:20.897407 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application Oct 13 10:57:20.897407 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 56/108] 10.222.0.18 () {56 vars in 1099 bytes} [Thu Oct 13 10:57:20 2022] GET /identity/v3/roles/member => generated 84 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 10:57:20.898049 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc26c448-4e57-43c4-896e-38196b2aa347 None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:57:20.907621 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60482010-e98a-4f5e-af5e-7bd8bae95e26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:57:20.908234 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60482010-e98a-4f5e-af5e-7bd8bae95e26 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:20.908519 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60482010-e98a-4f5e-af5e-7bd8bae95e26 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:20.909207 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60482010-e98a-4f5e-af5e-7bd8bae95e26 None admin] PATH_INFO: `/v3/roles` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:20.909893 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60482010-e98a-4f5e-af5e-7bd8bae95e26 None admin] RBAC: Adding query filter params (name=member) {{(pid=81534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 10:57:20.910209 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60482010-e98a-4f5e-af5e-7bd8bae95e26 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:57:20.911577 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60482010-e98a-4f5e-af5e-7bd8bae95e26 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:57:20.919857 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 53/109] 10.222.0.18 () {56 vars in 1101 bytes} [Thu Oct 13 10:57:20 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 10:57:20.920646 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60482010-e98a-4f5e-af5e-7bd8bae95e26 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:57:20.954571 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:57:20.998142 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc26c448-4e57-43c4-896e-38196b2aa347 None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:57:21.024437 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60482010-e98a-4f5e-af5e-7bd8bae95e26 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:57:21.031386 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1854eb78-46e6-43d2-b981-2f47c932e036 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:57:21.031998 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1854eb78-46e6-43d2-b981-2f47c932e036 None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:21.032277 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1854eb78-46e6-43d2-b981-2f47c932e036 None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:21.032550 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1854eb78-46e6-43d2-b981-2f47c932e036 None admin] PATH_INFO: `/v3/roles` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:21.033238 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1854eb78-46e6-43d2-b981-2f47c932e036 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81533) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 10:57:21.033544 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1854eb78-46e6-43d2-b981-2f47c932e036 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:57:21.034934 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1854eb78-46e6-43d2-b981-2f47c932e036 None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:57:21.043081 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 57/110] 10.222.0.18 () {56 vars in 1101 bytes} [Thu Oct 13 10:57:20 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 10:57:21.043866 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1854eb78-46e6-43d2-b981-2f47c932e036 None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:57:21.060777 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32c69e8-d8be-4657-beba-6dcb60a8aced None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:57:21.061438 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32c69e8-d8be-4657-beba-6dcb60a8aced None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:21.061728 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32c69e8-d8be-4657-beba-6dcb60a8aced None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:21.062007 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32c69e8-d8be-4657-beba-6dcb60a8aced None admin] PATH_INFO: `/v3/users/e6970c8c44f247bf84dac44daa2e7f44` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:21.063170 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32c69e8-d8be-4657-beba-6dcb60a8aced None admin] RBAC: Authorizing `identity:get_user(user_id=e6970c8c44f247bf84dac44daa2e7f44)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:57:21.064603 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32c69e8-d8be-4657-beba-6dcb60a8aced None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:57:21.066379 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 54/111] 10.222.0.18 () {56 vars in 1177 bytes} [Thu Oct 13 10:57:20 2022] GET /identity/v3/users/e6970c8c44f247bf84dac44daa2e7f44 => generated 275 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 10:57:21.066951 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32c69e8-d8be-4657-beba-6dcb60a8aced None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:57:21.103726 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:57:21.145802 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1854eb78-46e6-43d2-b981-2f47c932e036 None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:57:21.161904 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:57:21.165145 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32c69e8-d8be-4657-beba-6dcb60a8aced None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:57:21.179334 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e40f477-a66a-4708-b599-531b92ad68b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:57:21.179935 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e40f477-a66a-4708-b599-531b92ad68b2 None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:21.180233 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e40f477-a66a-4708-b599-531b92ad68b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:21.180483 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e40f477-a66a-4708-b599-531b92ad68b2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:21.181258 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e40f477-a66a-4708-b599-531b92ad68b2 None admin] RBAC: Adding query filter params (role.id=30a6d59262144d4d956f4d4207864030, scope.project.id=8b052a27256842f098af78fca7334623, user.id=8ba31ade43694cf8bf28f7528a9ea179) {{(pid=81533) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 10:57:21.181568 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e40f477-a66a-4708-b599-531b92ad68b2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:57:21.183521 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e40f477-a66a-4708-b599-531b92ad68b2 None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:57:21.190484 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 58/112] 10.222.0.18 () {56 vars in 1374 bytes} [Thu Oct 13 10:57:21 2022] GET /identity/v3/role_assignments?user.id=8ba31ade43694cf8bf28f7528a9ea179&scope.project.id=8b052a27256842f098af78fca7334623&role.id=30a6d59262144d4d956f4d4207864030 => generated 608 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 10:57:21.201490 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e40f477-a66a-4708-b599-531b92ad68b2 None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:57:21.210817 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81249ebf-c4ea-416a-a473-ae5badf821ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:57:21.211661 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81249ebf-c4ea-416a-a473-ae5badf821ca None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:21.211945 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81249ebf-c4ea-416a-a473-ae5badf821ca None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:21.212578 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81249ebf-c4ea-416a-a473-ae5badf821ca None admin] PATH_INFO: `/v3/domains/default` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:21.213965 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81249ebf-c4ea-416a-a473-ae5badf821ca None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:57:21.216190 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81249ebf-c4ea-416a-a473-ae5badf821ca None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:57:21.218100 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 55/113] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Oct 13 10:57:21 2022] GET /identity/v3/domains/default => generated 199 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 10:57:21.218851 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81249ebf-c4ea-416a-a473-ae5badf821ca None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:57:21.307622 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e40f477-a66a-4708-b599-531b92ad68b2 None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:57:21.334640 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:57:21.348368 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf75f39-d4e2-40ea-9c1e-938a945dfe31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:57:21.348769 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81249ebf-c4ea-416a-a473-ae5badf821ca None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:57:21.348990 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf75f39-d4e2-40ea-9c1e-938a945dfe31 None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:21.349296 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf75f39-d4e2-40ea-9c1e-938a945dfe31 None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:21.349568 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf75f39-d4e2-40ea-9c1e-938a945dfe31 None admin] PATH_INFO: `/v3/roles` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:21.350251 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf75f39-d4e2-40ea-9c1e-938a945dfe31 None admin] RBAC: Adding query filter params (name=member) {{(pid=81533) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 10:57:21.350550 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf75f39-d4e2-40ea-9c1e-938a945dfe31 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:57:21.352102 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf75f39-d4e2-40ea-9c1e-938a945dfe31 None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:57:21.361877 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 59/114] 10.222.0.18 () {56 vars in 1101 bytes} [Thu Oct 13 10:57:21 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 10:57:21.362574 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf75f39-d4e2-40ea-9c1e-938a945dfe31 None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:57:21.388625 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf616f63-6131-499f-9c14-8f270a70e33f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:57:21.389303 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf616f63-6131-499f-9c14-8f270a70e33f None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:21.390248 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf616f63-6131-499f-9c14-8f270a70e33f None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:21.390248 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf616f63-6131-499f-9c14-8f270a70e33f None admin] PATH_INFO: `/v3/users/e6970c8c44f247bf84dac44daa2e7f44` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:21.391931 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf616f63-6131-499f-9c14-8f270a70e33f None admin] RBAC: Authorizing `identity:get_user(user_id=e6970c8c44f247bf84dac44daa2e7f44)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:57:21.393407 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf616f63-6131-499f-9c14-8f270a70e33f None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:57:21.395014 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 56/115] 10.222.0.18 () {56 vars in 1177 bytes} [Thu Oct 13 10:57:21 2022] GET /identity/v3/users/e6970c8c44f247bf84dac44daa2e7f44 => generated 275 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 10:57:21.395781 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf616f63-6131-499f-9c14-8f270a70e33f None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:57:21.440127 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:57:21.471782 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf75f39-d4e2-40ea-9c1e-938a945dfe31 None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:57:21.504151 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf616f63-6131-499f-9c14-8f270a70e33f None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:57:21.505522 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6760a814-d811-4465-a7f7-38e586073748 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:57:21.506153 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6760a814-d811-4465-a7f7-38e586073748 None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:21.506441 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6760a814-d811-4465-a7f7-38e586073748 None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:21.506716 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6760a814-d811-4465-a7f7-38e586073748 None admin] PATH_INFO: `/v3/users/1f46560045084f2ab29d2a7edeaa3627` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:21.525324 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6760a814-d811-4465-a7f7-38e586073748 None admin] RBAC: Authorizing `identity:get_user(user_id=1f46560045084f2ab29d2a7edeaa3627)` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:57:21.527007 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6760a814-d811-4465-a7f7-38e586073748 None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:57:21.528669 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 60/116] 10.222.0.18 () {56 vars in 1177 bytes} [Thu Oct 13 10:57:21 2022] GET /identity/v3/users/1f46560045084f2ab29d2a7edeaa3627 => generated 289 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 10:57:21.529450 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6760a814-d811-4465-a7f7-38e586073748 None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:57:21.544305 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46364175-54a3-4448-bec5-f631aaffccc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:57:21.544917 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46364175-54a3-4448-bec5-f631aaffccc1 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:21.545231 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46364175-54a3-4448-bec5-f631aaffccc1 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:21.545509 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46364175-54a3-4448-bec5-f631aaffccc1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:21.572274 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:57:21.612344 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46364175-54a3-4448-bec5-f631aaffccc1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:57:21.613835 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46364175-54a3-4448-bec5-f631aaffccc1 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:57:21.628839 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6760a814-d811-4465-a7f7-38e586073748 None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:57:21.646778 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:57:21.662980 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1663795-4f51-4070-9dae-59fa5dbdda76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:57:21.663588 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1663795-4f51-4070-9dae-59fa5dbdda76 None admin] REQUEST_METHOD: `POST` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:21.663870 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1663795-4f51-4070-9dae-59fa5dbdda76 None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:21.664220 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1663795-4f51-4070-9dae-59fa5dbdda76 None admin] PATH_INFO: `/v3/projects` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:21.664873 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1663795-4f51-4070-9dae-59fa5dbdda76 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:57:21.666371 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1663795-4f51-4070-9dae-59fa5dbdda76 None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:57:21.694244 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 61/117] 10.222.0.18 () {60 vars in 1141 bytes} [Thu Oct 13 10:57:21 2022] POST /identity/v3/projects => generated 302 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 13 10:57:21.695255 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1663795-4f51-4070-9dae-59fa5dbdda76 None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:57:21.712481 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 57/118] 10.222.0.18 () {58 vars in 1282 bytes} [Thu Oct 13 10:57:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 13 10:57:21.718022 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46364175-54a3-4448-bec5-f631aaffccc1 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:57:21.826335 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:57:21.829657 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46364175-54a3-4448-bec5-f631aaffccc1 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:57:21.836072 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1663795-4f51-4070-9dae-59fa5dbdda76 None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:57:21.871607 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab0f090-ca68-461a-aaf1-fa2cc540ca03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:57:21.872160 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab0f090-ca68-461a-aaf1-fa2cc540ca03 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:21.872483 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab0f090-ca68-461a-aaf1-fa2cc540ca03 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:21.872760 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab0f090-ca68-461a-aaf1-fa2cc540ca03 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:21.876253 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:57:21.878012 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b723cf44-e029-4480-81ce-e748c33f3623 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:57:21.878659 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b723cf44-e029-4480-81ce-e748c33f3623 None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:21.878941 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b723cf44-e029-4480-81ce-e748c33f3623 None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:21.879916 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b723cf44-e029-4480-81ce-e748c33f3623 None admin] PATH_INFO: `/v3/users/e6970c8c44f247bf84dac44daa2e7f44` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:21.880590 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b723cf44-e029-4480-81ce-e748c33f3623 None admin] RBAC: Authorizing `identity:get_user(user_id=e6970c8c44f247bf84dac44daa2e7f44)` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:57:21.883600 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b723cf44-e029-4480-81ce-e748c33f3623 None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:57:21.885069 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 62/119] 10.222.0.18 () {56 vars in 1177 bytes} [Thu Oct 13 10:57:21 2022] GET /identity/v3/users/e6970c8c44f247bf84dac44daa2e7f44 => generated 275 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 10:57:21.885701 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b723cf44-e029-4480-81ce-e748c33f3623 None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:57:21.952614 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab0f090-ca68-461a-aaf1-fa2cc540ca03 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:57:21.954389 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab0f090-ca68-461a-aaf1-fa2cc540ca03 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:57:21.990897 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b723cf44-e029-4480-81ce-e748c33f3623 None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:57:22.027604 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d8af61-3fe3-4e18-a1c3-f93f2c0eb20b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:57:22.028513 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d8af61-3fe3-4e18-a1c3-f93f2c0eb20b None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:22.028970 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d8af61-3fe3-4e18-a1c3-f93f2c0eb20b None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:22.029453 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d8af61-3fe3-4e18-a1c3-f93f2c0eb20b None admin] PATH_INFO: `/v3/projects/8b052a27256842f098af78fca7334623` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:22.030877 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d8af61-3fe3-4e18-a1c3-f93f2c0eb20b None admin] RBAC: Authorizing `identity:get_project(project_id=8b052a27256842f098af78fca7334623)` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:57:22.032610 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d8af61-3fe3-4e18-a1c3-f93f2c0eb20b None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:57:22.034578 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 63/120] 10.222.0.18 () {56 vars in 1186 bytes} [Thu Oct 13 10:57:21 2022] GET /identity/v3/projects/8b052a27256842f098af78fca7334623 => generated 298 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 10:57:22.035341 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d8af61-3fe3-4e18-a1c3-f93f2c0eb20b None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:57:22.060621 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 58/121] 10.222.0.18 () {58 vars in 1282 bytes} [Thu Oct 13 10:57:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 13 10:57:22.060621 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab0f090-ca68-461a-aaf1-fa2cc540ca03 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:57:22.070479 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:57:22.098187 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:57:22.147093 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d8af61-3fe3-4e18-a1c3-f93f2c0eb20b None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:57:22.165995 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab0f090-ca68-461a-aaf1-fa2cc540ca03 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:57:22.183708 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209efbab-11ab-420c-aa6a-021bed8a2b2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:57:22.184461 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209efbab-11ab-420c-aa6a-021bed8a2b2a None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:22.184745 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209efbab-11ab-420c-aa6a-021bed8a2b2a None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:22.185191 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209efbab-11ab-420c-aa6a-021bed8a2b2a None admin] PATH_INFO: `/v3/projects/8b052a27256842f098af78fca7334623` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:22.186373 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209efbab-11ab-420c-aa6a-021bed8a2b2a None admin] RBAC: Authorizing `identity:get_project(project_id=8b052a27256842f098af78fca7334623)` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:57:22.188087 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209efbab-11ab-420c-aa6a-021bed8a2b2a None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:57:22.189778 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 64/122] 10.222.0.18 () {56 vars in 1186 bytes} [Thu Oct 13 10:57:22 2022] GET /identity/v3/projects/8b052a27256842f098af78fca7334623 => generated 298 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 10:57:22.190530 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209efbab-11ab-420c-aa6a-021bed8a2b2a None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:57:22.208015 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e73520-ee64-4b45-bc72-25fc44e307c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:57:22.208626 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e73520-ee64-4b45-bc72-25fc44e307c1 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:22.208908 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e73520-ee64-4b45-bc72-25fc44e307c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:22.209219 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e73520-ee64-4b45-bc72-25fc44e307c1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:22.281363 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e73520-ee64-4b45-bc72-25fc44e307c1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:57:22.282832 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e73520-ee64-4b45-bc72-25fc44e307c1 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:57:22.297629 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:57:22.302549 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209efbab-11ab-420c-aa6a-021bed8a2b2a None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:57:22.318938 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:57:22.337801 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de46860a-5459-495f-9256-e78214d9eb6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:57:22.339135 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de46860a-5459-495f-9256-e78214d9eb6f None admin] REQUEST_METHOD: `PUT` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:22.339480 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de46860a-5459-495f-9256-e78214d9eb6f None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:22.339779 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de46860a-5459-495f-9256-e78214d9eb6f None admin] PATH_INFO: `/v3/projects/8b052a27256842f098af78fca7334623/users/1f46560045084f2ab29d2a7edeaa3627/roles/f0789756c6f1413090292bae8bd8df5a` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:22.341926 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de46860a-5459-495f-9256-e78214d9eb6f None admin] RBAC: Authorizing `identity:create_grant(project_id=8b052a27256842f098af78fca7334623, user_id=1f46560045084f2ab29d2a7edeaa3627, role_id=f0789756c6f1413090292bae8bd8df5a)` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:57:22.343380 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de46860a-5459-495f-9256-e78214d9eb6f None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:57:22.356809 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 65/123] 10.222.0.18 () {58 vars in 1439 bytes} [Thu Oct 13 10:57:22 2022] PUT /identity/v3/projects/8b052a27256842f098af78fca7334623/users/1f46560045084f2ab29d2a7edeaa3627/roles/f0789756c6f1413090292bae8bd8df5a => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 10:57:22.357792 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de46860a-5459-495f-9256-e78214d9eb6f None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:57:22.404110 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 59/124] 10.222.0.18 () {58 vars in 1282 bytes} [Thu Oct 13 10:57:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 13 10:57:22.405113 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e73520-ee64-4b45-bc72-25fc44e307c1 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:57:22.489063 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de46860a-5459-495f-9256-e78214d9eb6f None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:57:22.530148 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396d1f78-f687-4b51-a92a-42b2e593ec8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:57:22.530801 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396d1f78-f687-4b51-a92a-42b2e593ec8e None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:22.531083 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396d1f78-f687-4b51-a92a-42b2e593ec8e None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:22.532298 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396d1f78-f687-4b51-a92a-42b2e593ec8e None admin] PATH_INFO: `/v3/projects/8b052a27256842f098af78fca7334623` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:22.534394 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-396d1f78-f687-4b51-a92a-42b2e593ec8e None admin] RBAC: Authorizing `identity:get_project(project_id=8b052a27256842f098af78fca7334623)` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:57:22.535872 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-396d1f78-f687-4b51-a92a-42b2e593ec8e None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:57:22.537441 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e73520-ee64-4b45-bc72-25fc44e307c1 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:57:22.537584 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 66/125] 10.222.0.18 () {56 vars in 1186 bytes} [Thu Oct 13 10:57:22 2022] GET /identity/v3/projects/8b052a27256842f098af78fca7334623 => generated 298 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 10:57:22.538326 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396d1f78-f687-4b51-a92a-42b2e593ec8e None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:57:22.571391 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:57:22.592104 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca63d6e-1103-4fec-a7e7-850a9f277b18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:57:22.592700 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca63d6e-1103-4fec-a7e7-850a9f277b18 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:22.592979 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca63d6e-1103-4fec-a7e7-850a9f277b18 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:22.593412 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca63d6e-1103-4fec-a7e7-850a9f277b18 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:22.594156 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca63d6e-1103-4fec-a7e7-850a9f277b18 None admin] RBAC: Adding query filter params (role.id=e49be8727cbd4a39b3fbe6925f5af415, scope.project.id=8b052a27256842f098af78fca7334623, user.id=e6970c8c44f247bf84dac44daa2e7f44) {{(pid=81534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 10:57:22.594459 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca63d6e-1103-4fec-a7e7-850a9f277b18 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:57:22.595895 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca63d6e-1103-4fec-a7e7-850a9f277b18 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:57:22.602284 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 60/126] 10.222.0.18 () {56 vars in 1374 bytes} [Thu Oct 13 10:57:22 2022] GET /identity/v3/role_assignments?user.id=e6970c8c44f247bf84dac44daa2e7f44&scope.project.id=8b052a27256842f098af78fca7334623&role.id=e49be8727cbd4a39b3fbe6925f5af415 => generated 608 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 10:57:22.603152 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca63d6e-1103-4fec-a7e7-850a9f277b18 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:57:22.608118 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:57:22.703666 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396d1f78-f687-4b51-a92a-42b2e593ec8e None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:57:22.793771 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca63d6e-1103-4fec-a7e7-850a9f277b18 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:57:22.818695 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd46dfa1-fac0-43d6-87ca-8c45aea19e5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:57:22.819710 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd46dfa1-fac0-43d6-87ca-8c45aea19e5a None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:22.820189 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd46dfa1-fac0-43d6-87ca-8c45aea19e5a None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:22.820662 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd46dfa1-fac0-43d6-87ca-8c45aea19e5a None admin] PATH_INFO: `/v3/projects/321d311de3ab42a7a6285fcf0f3c0968` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:22.822070 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd46dfa1-fac0-43d6-87ca-8c45aea19e5a None admin] RBAC: Authorizing `identity:get_project(project_id=321d311de3ab42a7a6285fcf0f3c0968)` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:57:22.823798 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd46dfa1-fac0-43d6-87ca-8c45aea19e5a None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:57:22.826088 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 67/127] 10.222.0.18 () {56 vars in 1186 bytes} [Thu Oct 13 10:57:22 2022] GET /identity/v3/projects/321d311de3ab42a7a6285fcf0f3c0968 => generated 312 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 10:57:22.831785 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd46dfa1-fac0-43d6-87ca-8c45aea19e5a None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:57:22.842504 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e777113-f08c-4cb4-a08b-4b716636ea1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:57:22.843134 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e777113-f08c-4cb4-a08b-4b716636ea1e None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:22.843421 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e777113-f08c-4cb4-a08b-4b716636ea1e None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:22.843703 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e777113-f08c-4cb4-a08b-4b716636ea1e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:22.844555 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e777113-f08c-4cb4-a08b-4b716636ea1e None admin] RBAC: Adding query filter params (role.id=a893cd4f751e445aab4dda1a832f24a1, scope.project.id=8b052a27256842f098af78fca7334623, user.id=e6970c8c44f247bf84dac44daa2e7f44) {{(pid=81534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 10:57:22.844874 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e777113-f08c-4cb4-a08b-4b716636ea1e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:57:22.846491 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e777113-f08c-4cb4-a08b-4b716636ea1e None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:57:22.858904 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 61/128] 10.222.0.18 () {56 vars in 1374 bytes} [Thu Oct 13 10:57:22 2022] GET /identity/v3/role_assignments?user.id=e6970c8c44f247bf84dac44daa2e7f44&scope.project.id=8b052a27256842f098af78fca7334623&role.id=a893cd4f751e445aab4dda1a832f24a1 => generated 608 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 10:57:22.948878 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:57:22.957271 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd46dfa1-fac0-43d6-87ca-8c45aea19e5a None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:57:23.003752 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec98175-ab08-446e-ba3a-ccc5ec5b6cdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:57:23.004379 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec98175-ab08-446e-ba3a-ccc5ec5b6cdc None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:23.004714 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec98175-ab08-446e-ba3a-ccc5ec5b6cdc None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:23.004995 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec98175-ab08-446e-ba3a-ccc5ec5b6cdc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:23.005822 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec98175-ab08-446e-ba3a-ccc5ec5b6cdc None admin] RBAC: Adding query filter params (role.id=a893cd4f751e445aab4dda1a832f24a1, scope.project.id=321d311de3ab42a7a6285fcf0f3c0968, user.id=e6970c8c44f247bf84dac44daa2e7f44) {{(pid=81533) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 10:57:23.006138 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec98175-ab08-446e-ba3a-ccc5ec5b6cdc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:57:23.007967 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec98175-ab08-446e-ba3a-ccc5ec5b6cdc None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:57:23.015492 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 68/129] 10.222.0.18 () {56 vars in 1374 bytes} [Thu Oct 13 10:57:22 2022] GET /identity/v3/role_assignments?user.id=e6970c8c44f247bf84dac44daa2e7f44&scope.project.id=321d311de3ab42a7a6285fcf0f3c0968&role.id=a893cd4f751e445aab4dda1a832f24a1 => generated 608 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 10:57:24.013597 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b682a72-13bf-4046-a0f0-dc2da2ec9f06 None None] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:24.014178 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b682a72-13bf-4046-a0f0-dc2da2ec9f06 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:24.014178 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b682a72-13bf-4046-a0f0-dc2da2ec9f06 None None] PATH_INFO: `/` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:24.015402 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 62/130] 10.222.0.18 () {54 vars in 927 bytes} [Thu Oct 13 10:57:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 10:57:24.020813 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9c9b55-8557-498a-9d7e-bf98b170d4f5 None None] REQUEST_METHOD: `POST` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:24.021268 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9c9b55-8557-498a-9d7e-bf98b170d4f5 None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:24.021398 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9c9b55-8557-498a-9d7e-bf98b170d4f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:24.039953 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.auth.core [None req-4b9c9b55-8557-498a-9d7e-bf98b170d4f5 None None] MFA Rules not processed for user `8ba31ade43694cf8bf28f7528a9ea179`. Rule list: `[]` (Enabled: `True`). {{(pid=81533) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 10:57:24.041176 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-4b9c9b55-8557-498a-9d7e-bf98b170d4f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 10:57:24.106002 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 69/131] 10.222.0.18 () {58 vars in 1024 bytes} [Thu Oct 13 10:57:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 13 10:57:24.375120 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b682a72-13bf-4046-a0f0-dc2da2ec9f06 None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:57:24.437655 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:57:24.477040 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b682a72-13bf-4046-a0f0-dc2da2ec9f06 None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:57:24.514686 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac1dd6a-f602-4bad-88c8-e411f21fbec8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:57:24.515315 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac1dd6a-f602-4bad-88c8-e411f21fbec8 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:24.515590 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac1dd6a-f602-4bad-88c8-e411f21fbec8 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:24.515859 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac1dd6a-f602-4bad-88c8-e411f21fbec8 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:24.516946 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac1dd6a-f602-4bad-88c8-e411f21fbec8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:57:24.518412 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac1dd6a-f602-4bad-88c8-e411f21fbec8 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:57:24.519986 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 63/132] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Oct 13 10:57:24 2022] GET /identity/v3/domains/default => generated 199 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 10:57:24.525579 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9c9b55-8557-498a-9d7e-bf98b170d4f5 None None] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:57:24.602003 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756b5469-b078-4087-8f00-9c484148653a None None] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:24.602285 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756b5469-b078-4087-8f00-9c484148653a None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:24.602564 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756b5469-b078-4087-8f00-9c484148653a None None] PATH_INFO: `/` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:24.604197 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 64/133] 10.222.0.18 () {54 vars in 927 bytes} [Thu Oct 13 10:57:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 13 10:57:24.609273 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eec83cb-975d-46e6-a723-e0629e407a63 None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:24.609559 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eec83cb-975d-46e6-a723-e0629e407a63 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:24.609835 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eec83cb-975d-46e6-a723-e0629e407a63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:24.611703 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:57:24.625089 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9c9b55-8557-498a-9d7e-bf98b170d4f5 None None] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:57:24.628248 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-8eec83cb-975d-46e6-a723-e0629e407a63 None None] MFA Rules not processed for user `8ba31ade43694cf8bf28f7528a9ea179`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 10:57:24.629423 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-8eec83cb-975d-46e6-a723-e0629e407a63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 10:57:24.660307 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b391513-4534-47f4-9b75-605fcf7cd801 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:57:24.660906 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b391513-4534-47f4-9b75-605fcf7cd801 None admin] REQUEST_METHOD: `POST` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:24.661210 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b391513-4534-47f4-9b75-605fcf7cd801 None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:24.661483 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b391513-4534-47f4-9b75-605fcf7cd801 None admin] PATH_INFO: `/v3/users` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:24.662142 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b391513-4534-47f4-9b75-605fcf7cd801 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:57:24.663571 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b391513-4534-47f4-9b75-605fcf7cd801 None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:57:24.684411 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 70/134] 10.222.0.18 () {60 vars in 1132 bytes} [Thu Oct 13 10:57:24 2022] POST /identity/v3/users => generated 283 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 13 10:57:24.698292 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 65/135] 10.222.0.18 () {58 vars in 1024 bytes} [Thu Oct 13 10:57:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 13 10:57:24.970361 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b391513-4534-47f4-9b75-605fcf7cd801 None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:57:25.077358 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b391513-4534-47f4-9b75-605fcf7cd801 None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:57:25.114173 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b7ab03-db20-43a6-9460-a842f152be7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:57:25.114812 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b7ab03-db20-43a6-9460-a842f152be7a None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:25.115096 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b7ab03-db20-43a6-9460-a842f152be7a None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:25.115371 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b7ab03-db20-43a6-9460-a842f152be7a None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:25.126878 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b7ab03-db20-43a6-9460-a842f152be7a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 13 10:57:25.132554 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application [None req-03b7ab03-db20-43a6-9460-a842f152be7a None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 13 10:57:25.132554 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 10:57:25.132554 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 10:57:25.132554 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 10:57:25.132554 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 10:57:25.132554 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 10:57:25.132554 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 10:57:25.132554 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 10:57:25.132554 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 10:57:25.132554 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 10:57:25.132554 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 10:57:25.132554 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 10:57:25.132554 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 13 10:57:25.132554 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 13 10:57:25.132554 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 13 10:57:25.132554 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 13 10:57:25.133561 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 13 10:57:25.133561 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 13 10:57:25.133561 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 13 10:57:25.133561 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 13 10:57:25.133561 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 10:57:25.133561 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 10:57:25.133561 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 10:57:25.133561 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 10:57:25.133561 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 10:57:25.133561 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 10:57:25.133561 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 10:57:25.133561 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application with Lock( Oct 13 10:57:25.133561 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 10:57:25.133561 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._enter() Oct 13 10:57:25.133561 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 10:57:25.133561 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 10:57:25.134380 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 10:57:25.134380 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.creator() Oct 13 10:57:25.134380 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 10:57:25.134380 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application created_value = creator( Oct 13 10:57:25.134380 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 13 10:57:25.134380 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 13 10:57:25.134380 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 13 10:57:25.134380 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 13 10:57:25.134380 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 13 10:57:25.134380 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 13 10:57:25.134380 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 13 10:57:25.134380 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application Oct 13 10:57:25.134380 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 71/136] 10.222.0.18 () {56 vars in 1099 bytes} [Thu Oct 13 10:57:24 2022] GET /identity/v3/roles/reader => generated 84 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 10:57:25.139960 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eec83cb-975d-46e6-a723-e0629e407a63 None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:57:25.206193 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:57:25.254569 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eec83cb-975d-46e6-a723-e0629e407a63 None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:57:25.295305 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d153d309-bca7-4cfb-bce2-c9510ae521a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:57:25.295910 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d153d309-bca7-4cfb-bce2-c9510ae521a5 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:25.296190 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d153d309-bca7-4cfb-bce2-c9510ae521a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:25.296459 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d153d309-bca7-4cfb-bce2-c9510ae521a5 None admin] PATH_INFO: `/v3/roles` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:25.297168 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d153d309-bca7-4cfb-bce2-c9510ae521a5 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 10:57:25.297473 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d153d309-bca7-4cfb-bce2-c9510ae521a5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:57:25.298852 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d153d309-bca7-4cfb-bce2-c9510ae521a5 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:57:25.308011 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 66/137] 10.222.0.18 () {56 vars in 1101 bytes} [Thu Oct 13 10:57:25 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 13 10:57:25.317877 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b7ab03-db20-43a6-9460-a842f152be7a None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:57:25.321705 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:57:25.426710 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b7ab03-db20-43a6-9460-a842f152be7a None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:57:25.462505 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2344a835-9626-4d35-906d-5fad91e097c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:57:25.463611 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2344a835-9626-4d35-906d-5fad91e097c4 None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:25.464108 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2344a835-9626-4d35-906d-5fad91e097c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:25.464582 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2344a835-9626-4d35-906d-5fad91e097c4 None admin] PATH_INFO: `/v3/users/1f46560045084f2ab29d2a7edeaa3627` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:25.465973 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2344a835-9626-4d35-906d-5fad91e097c4 None admin] RBAC: Authorizing `identity:get_user(user_id=1f46560045084f2ab29d2a7edeaa3627)` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:57:25.467747 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2344a835-9626-4d35-906d-5fad91e097c4 None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:57:25.469597 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 72/138] 10.222.0.18 () {56 vars in 1177 bytes} [Thu Oct 13 10:57:25 2022] GET /identity/v3/users/1f46560045084f2ab29d2a7edeaa3627 => generated 289 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 10:57:25.481120 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d153d309-bca7-4cfb-bce2-c9510ae521a5 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:57:25.598770 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d153d309-bca7-4cfb-bce2-c9510ae521a5 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:57:25.624877 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:57:25.638238 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9160d0f-35e6-472c-b4d3-6819355ee442 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:57:25.638853 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9160d0f-35e6-472c-b4d3-6819355ee442 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:25.639130 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9160d0f-35e6-472c-b4d3-6819355ee442 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:25.639404 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9160d0f-35e6-472c-b4d3-6819355ee442 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:25.716736 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9160d0f-35e6-472c-b4d3-6819355ee442 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:57:25.718223 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9160d0f-35e6-472c-b4d3-6819355ee442 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:57:25.827842 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 67/139] 10.222.0.18 () {58 vars in 1282 bytes} [Thu Oct 13 10:57:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 13 10:57:25.829471 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2344a835-9626-4d35-906d-5fad91e097c4 None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:57:25.904913 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:57:25.940123 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2344a835-9626-4d35-906d-5fad91e097c4 None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:57:25.975227 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4179ba6b-b36f-46f3-b9a0-4e6f42680628 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:57:25.975856 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4179ba6b-b36f-46f3-b9a0-4e6f42680628 None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:25.976134 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4179ba6b-b36f-46f3-b9a0-4e6f42680628 None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:25.976469 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4179ba6b-b36f-46f3-b9a0-4e6f42680628 None admin] PATH_INFO: `/v3/projects/8b052a27256842f098af78fca7334623` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:25.977616 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4179ba6b-b36f-46f3-b9a0-4e6f42680628 None admin] RBAC: Authorizing `identity:get_project(project_id=8b052a27256842f098af78fca7334623)` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:57:25.979589 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4179ba6b-b36f-46f3-b9a0-4e6f42680628 None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:57:25.981426 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 73/140] 10.222.0.18 () {56 vars in 1186 bytes} [Thu Oct 13 10:57:25 2022] GET /identity/v3/projects/8b052a27256842f098af78fca7334623 => generated 298 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 13 10:57:25.987335 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9160d0f-35e6-472c-b4d3-6819355ee442 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:57:26.012989 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:57:26.092450 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9160d0f-35e6-472c-b4d3-6819355ee442 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:57:26.127347 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5736e804-332a-425b-b417-8fd71b7aa9db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:57:26.127956 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5736e804-332a-425b-b417-8fd71b7aa9db None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:26.128319 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5736e804-332a-425b-b417-8fd71b7aa9db None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:26.128602 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5736e804-332a-425b-b417-8fd71b7aa9db None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:26.129365 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5736e804-332a-425b-b417-8fd71b7aa9db None admin] RBAC: Adding query filter params (role.id=f0789756c6f1413090292bae8bd8df5a, scope.project.id=8b052a27256842f098af78fca7334623, user.id=1f46560045084f2ab29d2a7edeaa3627) {{(pid=81534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 10:57:26.129675 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5736e804-332a-425b-b417-8fd71b7aa9db None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:57:26.131109 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5736e804-332a-425b-b417-8fd71b7aa9db None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:57:26.137192 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 68/141] 10.222.0.18 () {56 vars in 1374 bytes} [Thu Oct 13 10:57:25 2022] GET /identity/v3/role_assignments?user.id=1f46560045084f2ab29d2a7edeaa3627&scope.project.id=8b052a27256842f098af78fca7334623&role.id=f0789756c6f1413090292bae8bd8df5a => generated 608 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 13 10:57:26.982229 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f8df06-5132-4b84-af0c-1e5bd6dc55e3 None None] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:26.982729 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f8df06-5132-4b84-af0c-1e5bd6dc55e3 None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:26.982729 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f8df06-5132-4b84-af0c-1e5bd6dc55e3 None None] PATH_INFO: `/` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:26.984020 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 74/142] 10.222.0.18 () {54 vars in 927 bytes} [Thu Oct 13 10:57:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 10:57:26.989392 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ffdb8c-5efd-44e7-90c6-b8723a1fa1a6 None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:26.989802 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ffdb8c-5efd-44e7-90c6-b8723a1fa1a6 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:26.989949 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ffdb8c-5efd-44e7-90c6-b8723a1fa1a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:27.008920 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-03ffdb8c-5efd-44e7-90c6-b8723a1fa1a6 None None] MFA Rules not processed for user `8ba31ade43694cf8bf28f7528a9ea179`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 10:57:27.010708 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-03ffdb8c-5efd-44e7-90c6-b8723a1fa1a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 10:57:27.083760 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 69/143] 10.222.0.18 () {58 vars in 1024 bytes} [Thu Oct 13 10:57:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 13 10:57:27.165992 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac5230b-8436-4ea6-bba4-c896d707f806 None None] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:27.166279 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac5230b-8436-4ea6-bba4-c896d707f806 None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:27.166665 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac5230b-8436-4ea6-bba4-c896d707f806 None None] PATH_INFO: `/` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:27.168119 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 75/144] 10.222.0.18 () {54 vars in 927 bytes} [Thu Oct 13 10:57:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 10:57:27.173337 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9315d7d-494b-42df-a7db-af5ff40fc032 None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:27.173636 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9315d7d-494b-42df-a7db-af5ff40fc032 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:27.173918 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9315d7d-494b-42df-a7db-af5ff40fc032 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:27.194866 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-a9315d7d-494b-42df-a7db-af5ff40fc032 None None] MFA Rules not processed for user `8ba31ade43694cf8bf28f7528a9ea179`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 10:57:27.196347 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-a9315d7d-494b-42df-a7db-af5ff40fc032 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 10:57:27.210717 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:57:27.248811 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98d21a3-ffcd-48c3-8276-d28d273c117d None None] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:27.249315 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98d21a3-ffcd-48c3-8276-d28d273c117d None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:27.249740 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98d21a3-ffcd-48c3-8276-d28d273c117d None None] PATH_INFO: `/` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:27.251064 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 76/145] 10.222.0.18 () {54 vars in 927 bytes} [Thu Oct 13 10:57:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 13 10:57:27.256639 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccf60a0-3ea0-46bd-b3a7-91c9fe68ad2d None None] REQUEST_METHOD: `POST` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:27.257438 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccf60a0-3ea0-46bd-b3a7-91c9fe68ad2d None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:27.257850 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccf60a0-3ea0-46bd-b3a7-91c9fe68ad2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:27.267150 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 70/146] 10.222.0.18 () {58 vars in 1024 bytes} [Thu Oct 13 10:57:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 13 10:57:27.277179 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.auth.core [None req-3ccf60a0-3ea0-46bd-b3a7-91c9fe68ad2d None None] MFA Rules not processed for user `8ba31ade43694cf8bf28f7528a9ea179`. Rule list: `[]` (Enabled: `True`). {{(pid=81533) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 10:57:27.278549 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-3ccf60a0-3ea0-46bd-b3a7-91c9fe68ad2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 10:57:27.346126 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 77/147] 10.222.0.18 () {58 vars in 1024 bytes} [Thu Oct 13 10:57:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 13 10:57:27.353174 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9315d7d-494b-42df-a7db-af5ff40fc032 None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:57:27.459965 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9315d7d-494b-42df-a7db-af5ff40fc032 None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:57:27.493809 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0930594-4c3b-498d-ab10-cec8718afa1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:57:27.494479 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0930594-4c3b-498d-ab10-cec8718afa1c None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:27.494789 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0930594-4c3b-498d-ab10-cec8718afa1c None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:27.495138 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0930594-4c3b-498d-ab10-cec8718afa1c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:27.505057 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0930594-4c3b-498d-ab10-cec8718afa1c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 13 10:57:27.510600 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application [None req-a0930594-4c3b-498d-ab10-cec8718afa1c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 13 10:57:27.510600 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 10:57:27.510600 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 10:57:27.510600 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 10:57:27.510600 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 10:57:27.510600 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 10:57:27.510600 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 10:57:27.510600 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 10:57:27.510600 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 10:57:27.510600 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 10:57:27.510600 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 10:57:27.510600 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 10:57:27.510600 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 13 10:57:27.510600 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 13 10:57:27.510600 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 13 10:57:27.510600 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 13 10:57:27.511476 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 13 10:57:27.511476 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 13 10:57:27.511476 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 13 10:57:27.511476 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 13 10:57:27.511476 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 10:57:27.511476 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 10:57:27.511476 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 10:57:27.511476 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 10:57:27.511476 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 10:57:27.511476 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 10:57:27.511476 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 10:57:27.511476 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application with Lock( Oct 13 10:57:27.511476 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 10:57:27.511476 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._enter() Oct 13 10:57:27.511476 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 10:57:27.511476 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 10:57:27.512247 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 10:57:27.512247 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.creator() Oct 13 10:57:27.512247 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 10:57:27.512247 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application created_value = creator( Oct 13 10:57:27.512247 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 13 10:57:27.512247 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 13 10:57:27.512247 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 13 10:57:27.512247 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 13 10:57:27.512247 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 13 10:57:27.512247 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 13 10:57:27.512247 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 13 10:57:27.512247 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application Oct 13 10:57:27.512247 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 71/148] 10.222.0.18 () {56 vars in 1096 bytes} [Thu Oct 13 10:57:27 2022] GET /identity/v3/roles/admin => generated 83 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 10:57:27.517746 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ccf60a0-3ea0-46bd-b3a7-91c9fe68ad2d None None] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:57:27.544869 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0930594-4c3b-498d-ab10-cec8718afa1c None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:57:27.557452 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:57:27.594189 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:57:27.628831 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ccf60a0-3ea0-46bd-b3a7-91c9fe68ad2d None None] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:57:27.654171 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0930594-4c3b-498d-ab10-cec8718afa1c None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:57:27.663404 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0193e50-70d3-4135-b1c6-8b6a74c85c73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:57:27.664004 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0193e50-70d3-4135-b1c6-8b6a74c85c73 None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:27.664282 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0193e50-70d3-4135-b1c6-8b6a74c85c73 None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:27.664553 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0193e50-70d3-4135-b1c6-8b6a74c85c73 None admin] PATH_INFO: `/v3/roles` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:27.665240 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0193e50-70d3-4135-b1c6-8b6a74c85c73 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81533) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 10:57:27.665548 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0193e50-70d3-4135-b1c6-8b6a74c85c73 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:57:27.667580 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0193e50-70d3-4135-b1c6-8b6a74c85c73 None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:57:27.675661 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 78/149] 10.222.0.18 () {56 vars in 1099 bytes} [Thu Oct 13 10:57:27 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 13 10:57:27.676437 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0193e50-70d3-4135-b1c6-8b6a74c85c73 None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:57:27.692528 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5d7b46-09bd-410b-8bc4-22ab29012161 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:57:27.693197 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5d7b46-09bd-410b-8bc4-22ab29012161 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:27.693491 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5d7b46-09bd-410b-8bc4-22ab29012161 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:27.693768 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5d7b46-09bd-410b-8bc4-22ab29012161 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:27.703691 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5d7b46-09bd-410b-8bc4-22ab29012161 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 13 10:57:27.708564 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application [None req-1e5d7b46-09bd-410b-8bc4-22ab29012161 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 13 10:57:27.708564 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 10:57:27.708564 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 10:57:27.708564 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 10:57:27.708564 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 10:57:27.708564 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 10:57:27.708564 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 10:57:27.708564 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 10:57:27.708564 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 10:57:27.708564 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 10:57:27.708564 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 10:57:27.708564 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 10:57:27.708564 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 13 10:57:27.708564 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 13 10:57:27.708564 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 13 10:57:27.708564 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 13 10:57:27.709470 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 13 10:57:27.709470 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 13 10:57:27.709470 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 13 10:57:27.709470 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 13 10:57:27.709470 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 10:57:27.709470 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 10:57:27.709470 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 10:57:27.709470 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 10:57:27.709470 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 10:57:27.709470 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 10:57:27.709470 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 10:57:27.709470 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application with Lock( Oct 13 10:57:27.709470 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 10:57:27.709470 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._enter() Oct 13 10:57:27.709470 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 10:57:27.709470 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 10:57:27.710300 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 10:57:27.710300 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.creator() Oct 13 10:57:27.710300 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 10:57:27.710300 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application created_value = creator( Oct 13 10:57:27.710300 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 13 10:57:27.710300 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 13 10:57:27.710300 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 13 10:57:27.710300 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 13 10:57:27.710300 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 13 10:57:27.710300 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 13 10:57:27.710300 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 13 10:57:27.710300 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application Oct 13 10:57:27.710300 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 72/150] 10.222.0.18 () {56 vars in 1114 bytes} [Thu Oct 13 10:57:27 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 10:57:27.714425 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5d7b46-09bd-410b-8bc4-22ab29012161 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:57:27.775316 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0193e50-70d3-4135-b1c6-8b6a74c85c73 None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:57:27.783007 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:57:27.804783 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:57:27.810413 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e757d15f-36a9-4566-98c3-4b6271f88c86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:57:27.811043 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e757d15f-36a9-4566-98c3-4b6271f88c86 None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:27.811321 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e757d15f-36a9-4566-98c3-4b6271f88c86 None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:27.811595 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e757d15f-36a9-4566-98c3-4b6271f88c86 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:27.812697 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e757d15f-36a9-4566-98c3-4b6271f88c86 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:57:27.814183 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e757d15f-36a9-4566-98c3-4b6271f88c86 None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:57:27.815755 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 79/151] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Oct 13 10:57:27 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 10:57:27.816514 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e757d15f-36a9-4566-98c3-4b6271f88c86 None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:57:27.817174 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5d7b46-09bd-410b-8bc4-22ab29012161 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:57:27.850639 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6f37da-8ee8-4095-9293-fe406d239a89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:57:27.851348 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6f37da-8ee8-4095-9293-fe406d239a89 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:27.851632 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6f37da-8ee8-4095-9293-fe406d239a89 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:27.851905 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6f37da-8ee8-4095-9293-fe406d239a89 None admin] PATH_INFO: `/v3/users/bf56d2d8d4234cc3a4312b3c49dce457` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:27.864913 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6f37da-8ee8-4095-9293-fe406d239a89 None admin] RBAC: Authorizing `identity:get_user(user_id=bf56d2d8d4234cc3a4312b3c49dce457)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:57:27.866422 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6f37da-8ee8-4095-9293-fe406d239a89 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:57:27.868015 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 73/152] 10.222.0.18 () {56 vars in 1177 bytes} [Thu Oct 13 10:57:27 2022] GET /identity/v3/users/bf56d2d8d4234cc3a4312b3c49dce457 => generated 283 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 10:57:27.868759 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6f37da-8ee8-4095-9293-fe406d239a89 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:57:27.920744 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e757d15f-36a9-4566-98c3-4b6271f88c86 None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:57:27.954068 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec92de6-59b2-4551-9b34-6893d80c3da0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:57:27.954662 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec92de6-59b2-4551-9b34-6893d80c3da0 None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:27.954937 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec92de6-59b2-4551-9b34-6893d80c3da0 None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:27.955202 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec92de6-59b2-4551-9b34-6893d80c3da0 None admin] PATH_INFO: `/v3/roles` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:27.955849 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec92de6-59b2-4551-9b34-6893d80c3da0 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81533) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 10:57:27.956144 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec92de6-59b2-4551-9b34-6893d80c3da0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:57:27.957551 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec92de6-59b2-4551-9b34-6893d80c3da0 None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:57:27.965430 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 80/153] 10.222.0.18 () {56 vars in 1111 bytes} [Thu Oct 13 10:57:27 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 10:57:27.966196 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec92de6-59b2-4551-9b34-6893d80c3da0 None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:57:27.966629 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6f37da-8ee8-4095-9293-fe406d239a89 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:57:27.995562 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:57:28.004405 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5d0a38-c079-4d46-a1b7-354294b93382 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:57:28.005015 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5d0a38-c079-4d46-a1b7-354294b93382 None admin] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:28.005304 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5d0a38-c079-4d46-a1b7-354294b93382 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:28.005577 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5d0a38-c079-4d46-a1b7-354294b93382 None admin] PATH_INFO: `/v3/users` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:28.006228 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5d0a38-c079-4d46-a1b7-354294b93382 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:57:28.007905 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5d0a38-c079-4d46-a1b7-354294b93382 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:57:28.027650 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:57:28.029284 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 74/154] 10.222.0.18 () {60 vars in 1132 bytes} [Thu Oct 13 10:57:27 2022] POST /identity/v3/users => generated 297 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 13 10:57:28.030114 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5d0a38-c079-4d46-a1b7-354294b93382 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:57:28.074701 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec92de6-59b2-4551-9b34-6893d80c3da0 None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:57:28.116785 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4241ca1-20f1-40ba-9796-145c23c204f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:57:28.117884 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4241ca1-20f1-40ba-9796-145c23c204f9 None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:28.118163 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4241ca1-20f1-40ba-9796-145c23c204f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:28.118713 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4241ca1-20f1-40ba-9796-145c23c204f9 None admin] PATH_INFO: `/v3/projects/ab0fe3e4091a40ca831652b16957b46a` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:28.120538 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4241ca1-20f1-40ba-9796-145c23c204f9 None admin] RBAC: Authorizing `identity:get_project(project_id=ab0fe3e4091a40ca831652b16957b46a)` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:57:28.122903 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4241ca1-20f1-40ba-9796-145c23c204f9 None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:57:28.125662 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 81/155] 10.222.0.18 () {56 vars in 1186 bytes} [Thu Oct 13 10:57:27 2022] GET /identity/v3/projects/ab0fe3e4091a40ca831652b16957b46a => generated 302 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 10:57:28.131282 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4241ca1-20f1-40ba-9796-145c23c204f9 None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:57:28.142865 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5d0a38-c079-4d46-a1b7-354294b93382 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:57:28.179604 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3633abe-c473-4e73-861a-30b5b2ff3d25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:57:28.180582 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3633abe-c473-4e73-861a-30b5b2ff3d25 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:28.180871 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3633abe-c473-4e73-861a-30b5b2ff3d25 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:28.181340 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3633abe-c473-4e73-861a-30b5b2ff3d25 None admin] PATH_INFO: `/v3/users/bf56d2d8d4234cc3a4312b3c49dce457` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:28.182711 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3633abe-c473-4e73-861a-30b5b2ff3d25 None admin] RBAC: Authorizing `identity:get_user(user_id=bf56d2d8d4234cc3a4312b3c49dce457)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:57:28.184793 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3633abe-c473-4e73-861a-30b5b2ff3d25 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:57:28.186662 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 75/156] 10.222.0.18 () {56 vars in 1177 bytes} [Thu Oct 13 10:57:28 2022] GET /identity/v3/users/bf56d2d8d4234cc3a4312b3c49dce457 => generated 283 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 10:57:28.192180 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3633abe-c473-4e73-861a-30b5b2ff3d25 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:57:28.242772 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4241ca1-20f1-40ba-9796-145c23c204f9 None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:57:28.249759 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:57:28.283591 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:57:28.291778 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c69d54-5363-467c-b1ab-84bbb029a094 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:57:28.293063 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c69d54-5363-467c-b1ab-84bbb029a094 None admin] REQUEST_METHOD: `PUT` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:28.293063 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c69d54-5363-467c-b1ab-84bbb029a094 None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:28.293063 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c69d54-5363-467c-b1ab-84bbb029a094 None admin] PATH_INFO: `/v3/projects/ab0fe3e4091a40ca831652b16957b46a/users/bf56d2d8d4234cc3a4312b3c49dce457/roles/30a6d59262144d4d956f4d4207864030` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:28.298166 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c69d54-5363-467c-b1ab-84bbb029a094 None admin] RBAC: Authorizing `identity:create_grant(project_id=ab0fe3e4091a40ca831652b16957b46a, user_id=bf56d2d8d4234cc3a4312b3c49dce457, role_id=30a6d59262144d4d956f4d4207864030)` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:57:28.299607 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c69d54-5363-467c-b1ab-84bbb029a094 None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:57:28.314240 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 82/157] 10.222.0.18 () {58 vars in 1439 bytes} [Thu Oct 13 10:57:28 2022] PUT /identity/v3/projects/ab0fe3e4091a40ca831652b16957b46a/users/bf56d2d8d4234cc3a4312b3c49dce457/roles/30a6d59262144d4d956f4d4207864030 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 13 10:57:28.327173 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3633abe-c473-4e73-861a-30b5b2ff3d25 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:57:28.370651 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe43ad8-44ec-4fa7-b85c-8094fbb53ba8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:57:28.371312 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe43ad8-44ec-4fa7-b85c-8094fbb53ba8 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:28.371594 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe43ad8-44ec-4fa7-b85c-8094fbb53ba8 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:28.371869 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe43ad8-44ec-4fa7-b85c-8094fbb53ba8 None admin] PATH_INFO: `/v3/projects/ab0fe3e4091a40ca831652b16957b46a` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:28.373107 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe43ad8-44ec-4fa7-b85c-8094fbb53ba8 None admin] RBAC: Authorizing `identity:get_project(project_id=ab0fe3e4091a40ca831652b16957b46a)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:57:28.374607 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe43ad8-44ec-4fa7-b85c-8094fbb53ba8 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:57:28.376552 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 76/158] 10.222.0.18 () {56 vars in 1186 bytes} [Thu Oct 13 10:57:28 2022] GET /identity/v3/projects/ab0fe3e4091a40ca831652b16957b46a => generated 302 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 13 10:57:28.382582 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c69d54-5363-467c-b1ab-84bbb029a094 None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:57:28.499977 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c69d54-5363-467c-b1ab-84bbb029a094 None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:57:28.535954 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd0ba93-fa24-4535-a5b9-8a0b13a10275 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:57:28.536537 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd0ba93-fa24-4535-a5b9-8a0b13a10275 None admin] REQUEST_METHOD: `PUT` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:28.536817 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd0ba93-fa24-4535-a5b9-8a0b13a10275 None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:28.537109 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd0ba93-fa24-4535-a5b9-8a0b13a10275 None admin] PATH_INFO: `/v3/projects/ab0fe3e4091a40ca831652b16957b46a/users/bf56d2d8d4234cc3a4312b3c49dce457/roles/e49be8727cbd4a39b3fbe6925f5af415` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:28.539287 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd0ba93-fa24-4535-a5b9-8a0b13a10275 None admin] RBAC: Authorizing `identity:create_grant(project_id=ab0fe3e4091a40ca831652b16957b46a, user_id=bf56d2d8d4234cc3a4312b3c49dce457, role_id=e49be8727cbd4a39b3fbe6925f5af415)` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:57:28.540741 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd0ba93-fa24-4535-a5b9-8a0b13a10275 None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:57:28.555925 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 83/159] 10.222.0.18 () {58 vars in 1439 bytes} [Thu Oct 13 10:57:28 2022] PUT /identity/v3/projects/ab0fe3e4091a40ca831652b16957b46a/users/bf56d2d8d4234cc3a4312b3c49dce457/roles/e49be8727cbd4a39b3fbe6925f5af415 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 10:57:30.372636 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cc1ca1-61aa-4c0b-ad51-daba225f70b3 None None] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:30.373178 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cc1ca1-61aa-4c0b-ad51-daba225f70b3 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:30.373296 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cc1ca1-61aa-4c0b-ad51-daba225f70b3 None None] PATH_INFO: `/` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:30.374556 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 77/160] 10.222.0.18 () {54 vars in 927 bytes} [Thu Oct 13 10:57:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 10:57:30.379912 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb97a9c-79e8-4f9b-8b68-620af56ced97 None None] REQUEST_METHOD: `POST` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:30.380322 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb97a9c-79e8-4f9b-8b68-620af56ced97 None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:30.380510 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb97a9c-79e8-4f9b-8b68-620af56ced97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:30.400055 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.auth.core [None req-fdb97a9c-79e8-4f9b-8b68-620af56ced97 None None] MFA Rules not processed for user `8ba31ade43694cf8bf28f7528a9ea179`. Rule list: `[]` (Enabled: `True`). {{(pid=81533) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 10:57:30.401399 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-fdb97a9c-79e8-4f9b-8b68-620af56ced97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 10:57:30.412789 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f94da8-50c2-4f48-81b0-340084d26293 None None] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:30.413153 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f94da8-50c2-4f48-81b0-340084d26293 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:30.413466 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f94da8-50c2-4f48-81b0-340084d26293 None None] PATH_INFO: `/` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:30.415308 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 78/161] 10.222.0.18 () {54 vars in 927 bytes} [Thu Oct 13 10:57:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 10:57:30.422167 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f7a04e-10a8-4eb8-9280-022eb1f20245 None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:30.422489 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f7a04e-10a8-4eb8-9280-022eb1f20245 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:30.422715 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f7a04e-10a8-4eb8-9280-022eb1f20245 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:30.442556 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-d1f7a04e-10a8-4eb8-9280-022eb1f20245 None None] MFA Rules not processed for user `8ba31ade43694cf8bf28f7528a9ea179`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 10:57:30.443915 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-d1f7a04e-10a8-4eb8-9280-022eb1f20245 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 10:57:30.464504 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:57:30.495759 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 84/162] 10.222.0.18 () {58 vars in 1024 bytes} [Thu Oct 13 10:57:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 13 10:57:30.523158 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 79/163] 10.222.0.18 () {58 vars in 1024 bytes} [Thu Oct 13 10:57:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 13 10:57:30.552079 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9afafce-4a34-4f32-8300-a38e0354465d None None] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:30.552350 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9afafce-4a34-4f32-8300-a38e0354465d None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:30.552623 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9afafce-4a34-4f32-8300-a38e0354465d None None] PATH_INFO: `/` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:30.554008 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 85/164] 10.222.0.18 () {54 vars in 927 bytes} [Thu Oct 13 10:57:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 10:57:30.559954 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34ed0ec-3cb7-4149-a2b6-c51123bfed70 None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:30.560237 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34ed0ec-3cb7-4149-a2b6-c51123bfed70 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:30.560512 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34ed0ec-3cb7-4149-a2b6-c51123bfed70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:30.578907 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-f34ed0ec-3cb7-4149-a2b6-c51123bfed70 None None] MFA Rules not processed for user `8ba31ade43694cf8bf28f7528a9ea179`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 10:57:30.580167 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-f34ed0ec-3cb7-4149-a2b6-c51123bfed70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 10:57:30.626690 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:57:30.652309 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 80/165] 10.222.0.18 () {58 vars in 1024 bytes} [Thu Oct 13 10:57:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 13 10:57:30.790439 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f935ff-23f6-466f-92d9-3fa754168153 None None] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:30.790782 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f935ff-23f6-466f-92d9-3fa754168153 None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:30.791625 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f935ff-23f6-466f-92d9-3fa754168153 None None] PATH_INFO: `/` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:30.793665 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 86/166] 10.222.0.18 () {54 vars in 927 bytes} [Thu Oct 13 10:57:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 10:57:30.793793 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34ed0ec-3cb7-4149-a2b6-c51123bfed70 None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:57:30.796881 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f935ff-23f6-466f-92d9-3fa754168153 None None] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:57:30.898687 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34ed0ec-3cb7-4149-a2b6-c51123bfed70 None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:57:30.902943 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f935ff-23f6-466f-92d9-3fa754168153 None None] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:57:30.936079 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69e1eec-1eb6-4084-9dae-8d98b49425dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:57:30.936716 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69e1eec-1eb6-4084-9dae-8d98b49425dc None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:30.936997 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69e1eec-1eb6-4084-9dae-8d98b49425dc None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:30.937308 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69e1eec-1eb6-4084-9dae-8d98b49425dc None admin] PATH_INFO: `/v3/domains/default` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:30.938421 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b69e1eec-1eb6-4084-9dae-8d98b49425dc None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:57:30.938574 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74fc2df9-c44e-4104-bdca-50001764a62e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:57:30.939193 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fc2df9-c44e-4104-bdca-50001764a62e None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:30.939465 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fc2df9-c44e-4104-bdca-50001764a62e None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:30.939731 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fc2df9-c44e-4104-bdca-50001764a62e None admin] PATH_INFO: `/v3/roles/member` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:30.939874 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b69e1eec-1eb6-4084-9dae-8d98b49425dc None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:57:30.941495 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 81/167] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Oct 13 10:57:30 2022] GET /identity/v3/domains/default => generated 199 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 13 10:57:30.942588 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6277d36c-12a4-459f-8d5c-f523d057ca3b None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:30.942874 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6277d36c-12a4-459f-8d5c-f523d057ca3b None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:30.943145 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6277d36c-12a4-459f-8d5c-f523d057ca3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:30.951113 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74fc2df9-c44e-4104-bdca-50001764a62e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 13 10:57:30.955989 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application [None req-74fc2df9-c44e-4104-bdca-50001764a62e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 13 10:57:30.955989 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 10:57:30.955989 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 10:57:30.955989 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 10:57:30.955989 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 10:57:30.955989 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 10:57:30.955989 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 10:57:30.955989 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 10:57:30.955989 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 10:57:30.955989 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 10:57:30.955989 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 10:57:30.955989 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 10:57:30.955989 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 13 10:57:30.955989 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 13 10:57:30.955989 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 13 10:57:30.955989 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 13 10:57:30.957174 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 13 10:57:30.957174 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 13 10:57:30.957174 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 13 10:57:30.957174 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 13 10:57:30.957174 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 10:57:30.957174 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 10:57:30.957174 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 10:57:30.957174 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 10:57:30.957174 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 10:57:30.957174 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 10:57:30.957174 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 10:57:30.957174 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application with Lock( Oct 13 10:57:30.957174 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 10:57:30.957174 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._enter() Oct 13 10:57:30.957174 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 10:57:30.957174 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 10:57:30.958209 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 10:57:30.958209 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.creator() Oct 13 10:57:30.958209 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 10:57:30.958209 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application created_value = creator( Oct 13 10:57:30.958209 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 13 10:57:30.958209 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 13 10:57:30.958209 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 13 10:57:30.958209 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 13 10:57:30.958209 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 13 10:57:30.958209 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 13 10:57:30.958209 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 13 10:57:30.958209 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application Oct 13 10:57:30.958209 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 87/168] 10.222.0.18 () {56 vars in 1099 bytes} [Thu Oct 13 10:57:30 2022] GET /identity/v3/roles/member => generated 84 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 13 10:57:30.958209 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74fc2df9-c44e-4104-bdca-50001764a62e None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:57:30.961179 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-6277d36c-12a4-459f-8d5c-f523d057ca3b None None] MFA Rules not processed for user `8ba31ade43694cf8bf28f7528a9ea179`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 10:57:30.962372 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-6277d36c-12a4-459f-8d5c-f523d057ca3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 10:57:31.000424 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:57:31.004736 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:57:31.030300 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 82/169] 10.222.0.18 () {58 vars in 1024 bytes} [Thu Oct 13 10:57:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 13 10:57:31.030912 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6277d36c-12a4-459f-8d5c-f523d057ca3b None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:57:31.059849 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74fc2df9-c44e-4104-bdca-50001764a62e None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:57:31.097304 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3b781a-47ef-4ce0-91b7-ed53b4cb02dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:57:31.097850 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3b781a-47ef-4ce0-91b7-ed53b4cb02dc None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:31.098130 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3b781a-47ef-4ce0-91b7-ed53b4cb02dc None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:31.098401 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3b781a-47ef-4ce0-91b7-ed53b4cb02dc None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:31.108644 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3b781a-47ef-4ce0-91b7-ed53b4cb02dc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 13 10:57:31.113533 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application [None req-0c3b781a-47ef-4ce0-91b7-ed53b4cb02dc None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 13 10:57:31.113533 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 10:57:31.113533 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 10:57:31.113533 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 10:57:31.113533 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 10:57:31.113533 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 10:57:31.113533 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 10:57:31.113533 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 10:57:31.113533 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 10:57:31.113533 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 10:57:31.113533 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 10:57:31.113533 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 10:57:31.113533 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 13 10:57:31.113533 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 13 10:57:31.113533 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 13 10:57:31.113533 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 13 10:57:31.114429 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 13 10:57:31.114429 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 13 10:57:31.114429 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 13 10:57:31.114429 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 13 10:57:31.114429 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 10:57:31.114429 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 10:57:31.114429 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 10:57:31.114429 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 10:57:31.114429 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 10:57:31.114429 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 10:57:31.114429 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 10:57:31.114429 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application with Lock( Oct 13 10:57:31.114429 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 10:57:31.114429 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._enter() Oct 13 10:57:31.114429 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 10:57:31.114429 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 10:57:31.115261 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 10:57:31.115261 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.creator() Oct 13 10:57:31.115261 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 10:57:31.115261 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application created_value = creator( Oct 13 10:57:31.115261 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 13 10:57:31.115261 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 13 10:57:31.115261 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 13 10:57:31.115261 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 13 10:57:31.115261 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 13 10:57:31.115261 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 13 10:57:31.115261 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 13 10:57:31.115261 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application Oct 13 10:57:31.115261 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 88/170] 10.222.0.18 () {56 vars in 1096 bytes} [Thu Oct 13 10:57:30 2022] GET /identity/v3/roles/admin => generated 83 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 10:57:31.120101 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3b781a-47ef-4ce0-91b7-ed53b4cb02dc None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:57:31.141847 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6277d36c-12a4-459f-8d5c-f523d057ca3b None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:57:31.176513 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f543a3e4-e816-4017-8e38-34f7fd820ca4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:57:31.177150 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f543a3e4-e816-4017-8e38-34f7fd820ca4 None admin] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:31.177437 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f543a3e4-e816-4017-8e38-34f7fd820ca4 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:31.177708 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f543a3e4-e816-4017-8e38-34f7fd820ca4 None admin] PATH_INFO: `/v3/users` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:31.178365 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f543a3e4-e816-4017-8e38-34f7fd820ca4 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:57:31.179798 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f543a3e4-e816-4017-8e38-34f7fd820ca4 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:57:31.202423 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 83/171] 10.222.0.18 () {60 vars in 1132 bytes} [Thu Oct 13 10:57:31 2022] POST /identity/v3/users => generated 297 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 13 10:57:31.203235 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f543a3e4-e816-4017-8e38-34f7fd820ca4 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:57:31.239872 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:57:31.248414 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:57:31.253601 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3b781a-47ef-4ce0-91b7-ed53b4cb02dc None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:57:31.304729 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb257863-9dbd-46cb-81c6-7786028bc46e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:57:31.305688 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb257863-9dbd-46cb-81c6-7786028bc46e None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:31.305972 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb257863-9dbd-46cb-81c6-7786028bc46e None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:31.306248 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb257863-9dbd-46cb-81c6-7786028bc46e None admin] PATH_INFO: `/v3/roles` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:31.307006 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb257863-9dbd-46cb-81c6-7786028bc46e None admin] RBAC: Adding query filter params (name=member) {{(pid=81533) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 10:57:31.307306 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb257863-9dbd-46cb-81c6-7786028bc46e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:57:31.308716 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb257863-9dbd-46cb-81c6-7786028bc46e None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:57:31.319584 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 89/172] 10.222.0.18 () {56 vars in 1101 bytes} [Thu Oct 13 10:57:31 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 10:57:31.319584 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb257863-9dbd-46cb-81c6-7786028bc46e None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:57:31.327613 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f543a3e4-e816-4017-8e38-34f7fd820ca4 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:57:31.365941 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8596505-a073-4f20-b613-74f16e3c96a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:57:31.366549 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8596505-a073-4f20-b613-74f16e3c96a7 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:31.366824 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8596505-a073-4f20-b613-74f16e3c96a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:31.367090 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8596505-a073-4f20-b613-74f16e3c96a7 None admin] PATH_INFO: `/v3/roles` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:31.367829 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8596505-a073-4f20-b613-74f16e3c96a7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 10:57:31.368135 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8596505-a073-4f20-b613-74f16e3c96a7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:57:31.370333 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8596505-a073-4f20-b613-74f16e3c96a7 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:57:31.379890 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 84/173] 10.222.0.18 () {56 vars in 1099 bytes} [Thu Oct 13 10:57:31 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 10:57:31.381508 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8596505-a073-4f20-b613-74f16e3c96a7 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:57:31.436807 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb257863-9dbd-46cb-81c6-7786028bc46e None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:57:31.476703 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64677645-c2d4-4273-b989-8417d81669aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:57:31.477377 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64677645-c2d4-4273-b989-8417d81669aa None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:31.477657 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64677645-c2d4-4273-b989-8417d81669aa None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:31.477933 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64677645-c2d4-4273-b989-8417d81669aa None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:31.489129 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64677645-c2d4-4273-b989-8417d81669aa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 13 10:57:31.494997 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application [None req-64677645-c2d4-4273-b989-8417d81669aa None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 13 10:57:31.494997 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 10:57:31.494997 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 10:57:31.494997 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 10:57:31.494997 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 10:57:31.494997 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 10:57:31.494997 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 10:57:31.494997 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 10:57:31.494997 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 10:57:31.494997 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 10:57:31.494997 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 10:57:31.494997 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 10:57:31.494997 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 13 10:57:31.494997 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 13 10:57:31.494997 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 13 10:57:31.494997 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 13 10:57:31.496106 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 13 10:57:31.496106 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 13 10:57:31.496106 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 13 10:57:31.496106 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 13 10:57:31.496106 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 10:57:31.496106 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 10:57:31.496106 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 10:57:31.496106 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 10:57:31.496106 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 10:57:31.496106 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 10:57:31.496106 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 10:57:31.496106 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application with Lock( Oct 13 10:57:31.496106 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 10:57:31.496106 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._enter() Oct 13 10:57:31.496106 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 10:57:31.496106 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 10:57:31.497117 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 10:57:31.497117 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.creator() Oct 13 10:57:31.497117 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 10:57:31.497117 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application created_value = creator( Oct 13 10:57:31.497117 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 13 10:57:31.497117 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 13 10:57:31.497117 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 13 10:57:31.497117 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 13 10:57:31.497117 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 13 10:57:31.497117 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 13 10:57:31.497117 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 13 10:57:31.497117 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application Oct 13 10:57:31.497117 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 90/174] 10.222.0.18 () {56 vars in 1114 bytes} [Thu Oct 13 10:57:31 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 10:57:31.497117 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64677645-c2d4-4273-b989-8417d81669aa None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:57:31.500093 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:57:31.506343 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8596505-a073-4f20-b613-74f16e3c96a7 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:57:31.533609 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:57:31.556327 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e717cf9-2190-4a27-8669-b9ad8f500f2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:57:31.558408 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e717cf9-2190-4a27-8669-b9ad8f500f2e None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:31.558808 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e717cf9-2190-4a27-8669-b9ad8f500f2e None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:31.558951 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e717cf9-2190-4a27-8669-b9ad8f500f2e None admin] PATH_INFO: `/v3/users/1836bcab3e2d4c8babc7eb259e42569e` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:31.574860 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e717cf9-2190-4a27-8669-b9ad8f500f2e None admin] RBAC: Authorizing `identity:get_user(user_id=1836bcab3e2d4c8babc7eb259e42569e)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:57:31.576384 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e717cf9-2190-4a27-8669-b9ad8f500f2e None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:57:31.582571 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 85/175] 10.222.0.18 () {56 vars in 1177 bytes} [Thu Oct 13 10:57:31 2022] GET /identity/v3/users/1836bcab3e2d4c8babc7eb259e42569e => generated 297 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 10:57:31.582571 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e717cf9-2190-4a27-8669-b9ad8f500f2e None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:57:31.627215 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64677645-c2d4-4273-b989-8417d81669aa None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:57:31.670027 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edee3fbe-eb12-44af-ab17-c70b7cbe8460 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:57:31.671054 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edee3fbe-eb12-44af-ab17-c70b7cbe8460 None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:31.671748 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edee3fbe-eb12-44af-ab17-c70b7cbe8460 None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:31.673059 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edee3fbe-eb12-44af-ab17-c70b7cbe8460 None admin] PATH_INFO: `/v3/users/bf56d2d8d4234cc3a4312b3c49dce457` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:31.674432 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edee3fbe-eb12-44af-ab17-c70b7cbe8460 None admin] RBAC: Authorizing `identity:get_user(user_id=bf56d2d8d4234cc3a4312b3c49dce457)` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:57:31.676125 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edee3fbe-eb12-44af-ab17-c70b7cbe8460 None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:57:31.678500 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 91/176] 10.222.0.18 () {56 vars in 1177 bytes} [Thu Oct 13 10:57:31 2022] GET /identity/v3/users/bf56d2d8d4234cc3a4312b3c49dce457 => generated 283 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 10:57:31.679559 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edee3fbe-eb12-44af-ab17-c70b7cbe8460 None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:57:31.705992 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e717cf9-2190-4a27-8669-b9ad8f500f2e None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:57:31.749365 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a6d255-d0ee-4aa4-a422-36624e9ee84c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:57:31.750129 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a6d255-d0ee-4aa4-a422-36624e9ee84c None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:31.750502 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a6d255-d0ee-4aa4-a422-36624e9ee84c None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:31.750941 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a6d255-d0ee-4aa4-a422-36624e9ee84c None admin] PATH_INFO: `/v3/roles` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:31.751792 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a6d255-d0ee-4aa4-a422-36624e9ee84c None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 10:57:31.752304 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a6d255-d0ee-4aa4-a422-36624e9ee84c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:57:31.753710 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a6d255-d0ee-4aa4-a422-36624e9ee84c None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:57:31.763811 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 86/177] 10.222.0.18 () {56 vars in 1111 bytes} [Thu Oct 13 10:57:31 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 10:57:31.764770 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a6d255-d0ee-4aa4-a422-36624e9ee84c None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:57:31.782129 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:57:31.806079 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:57:31.819348 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edee3fbe-eb12-44af-ab17-c70b7cbe8460 None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:57:31.857462 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4996abfd-be47-4b33-8142-891e344a5a36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:57:31.858315 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4996abfd-be47-4b33-8142-891e344a5a36 None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:31.858671 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4996abfd-be47-4b33-8142-891e344a5a36 None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:31.859043 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4996abfd-be47-4b33-8142-891e344a5a36 None admin] PATH_INFO: `/v3/projects/ab0fe3e4091a40ca831652b16957b46a` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:31.860410 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4996abfd-be47-4b33-8142-891e344a5a36 None admin] RBAC: Authorizing `identity:get_project(project_id=ab0fe3e4091a40ca831652b16957b46a)` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:57:31.862080 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4996abfd-be47-4b33-8142-891e344a5a36 None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:57:31.863823 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 92/178] 10.222.0.18 () {56 vars in 1186 bytes} [Thu Oct 13 10:57:31 2022] GET /identity/v3/projects/ab0fe3e4091a40ca831652b16957b46a => generated 302 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 10:57:31.865104 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4996abfd-be47-4b33-8142-891e344a5a36 None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:57:31.908558 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a6d255-d0ee-4aa4-a422-36624e9ee84c None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:57:31.955257 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094893f1-6616-4526-9c62-922d4980d581 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:57:31.956351 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094893f1-6616-4526-9c62-922d4980d581 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:31.956974 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094893f1-6616-4526-9c62-922d4980d581 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:31.957508 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094893f1-6616-4526-9c62-922d4980d581 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:31.986470 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4996abfd-be47-4b33-8142-891e344a5a36 None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:57:32.024401 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebb7919-2020-4ace-921a-215d6ae2614a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:57:32.025038 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebb7919-2020-4ace-921a-215d6ae2614a None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:32.025490 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebb7919-2020-4ace-921a-215d6ae2614a None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:32.025775 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebb7919-2020-4ace-921a-215d6ae2614a None admin] PATH_INFO: `/v3/users/bf56d2d8d4234cc3a4312b3c49dce457` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:32.027008 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ebb7919-2020-4ace-921a-215d6ae2614a None admin] RBAC: Authorizing `identity:get_user(user_id=bf56d2d8d4234cc3a4312b3c49dce457)` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:57:32.028537 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ebb7919-2020-4ace-921a-215d6ae2614a None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:57:32.030442 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 93/179] 10.222.0.18 () {56 vars in 1177 bytes} [Thu Oct 13 10:57:31 2022] GET /identity/v3/users/bf56d2d8d4234cc3a4312b3c49dce457 => generated 283 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 10:57:32.031198 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebb7919-2020-4ace-921a-215d6ae2614a None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:57:32.048233 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094893f1-6616-4526-9c62-922d4980d581 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:57:32.050459 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094893f1-6616-4526-9c62-922d4980d581 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:57:32.060362 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:57:32.071109 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:57:32.138185 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebb7919-2020-4ace-921a-215d6ae2614a None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:57:32.175208 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3edd59-70bb-4d58-8f2a-f1ce0ca254d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:57:32.175931 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3edd59-70bb-4d58-8f2a-f1ce0ca254d7 None admin] REQUEST_METHOD: `PUT` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:32.176251 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3edd59-70bb-4d58-8f2a-f1ce0ca254d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:32.176467 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3edd59-70bb-4d58-8f2a-f1ce0ca254d7 None admin] PATH_INFO: `/v3/projects/ab0fe3e4091a40ca831652b16957b46a/users/1836bcab3e2d4c8babc7eb259e42569e/roles/a893cd4f751e445aab4dda1a832f24a1` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:32.178460 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3edd59-70bb-4d58-8f2a-f1ce0ca254d7 None admin] RBAC: Authorizing `identity:create_grant(project_id=ab0fe3e4091a40ca831652b16957b46a, user_id=1836bcab3e2d4c8babc7eb259e42569e, role_id=a893cd4f751e445aab4dda1a832f24a1)` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:57:32.179990 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3edd59-70bb-4d58-8f2a-f1ce0ca254d7 None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:57:32.191988 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 87/180] 10.222.0.18 () {58 vars in 1282 bytes} [Thu Oct 13 10:57:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 428 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 13 10:57:32.194918 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094893f1-6616-4526-9c62-922d4980d581 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:57:32.200081 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 94/181] 10.222.0.18 () {58 vars in 1439 bytes} [Thu Oct 13 10:57:32 2022] PUT /identity/v3/projects/ab0fe3e4091a40ca831652b16957b46a/users/1836bcab3e2d4c8babc7eb259e42569e/roles/a893cd4f751e445aab4dda1a832f24a1 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 10:57:32.201030 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3edd59-70bb-4d58-8f2a-f1ce0ca254d7 None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:57:32.300237 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:57:32.342765 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094893f1-6616-4526-9c62-922d4980d581 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:57:32.347288 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3edd59-70bb-4d58-8f2a-f1ce0ca254d7 None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:57:32.360881 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:57:32.386455 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f152669c-e65c-4815-af48-eb6ade08304b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:57:32.387911 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f152669c-e65c-4815-af48-eb6ade08304b None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:32.388406 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f152669c-e65c-4815-af48-eb6ade08304b None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:32.388902 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f152669c-e65c-4815-af48-eb6ade08304b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:32.452677 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05332d07-757b-490c-adc2-9b8e2de857d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:57:32.453423 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05332d07-757b-490c-adc2-9b8e2de857d8 None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:32.453629 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05332d07-757b-490c-adc2-9b8e2de857d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:32.453904 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05332d07-757b-490c-adc2-9b8e2de857d8 None admin] PATH_INFO: `/v3/projects/ab0fe3e4091a40ca831652b16957b46a` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:32.457799 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05332d07-757b-490c-adc2-9b8e2de857d8 None admin] RBAC: Authorizing `identity:get_project(project_id=ab0fe3e4091a40ca831652b16957b46a)` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:57:32.459271 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05332d07-757b-490c-adc2-9b8e2de857d8 None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:57:32.461146 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 95/182] 10.222.0.18 () {56 vars in 1186 bytes} [Thu Oct 13 10:57:32 2022] GET /identity/v3/projects/ab0fe3e4091a40ca831652b16957b46a => generated 302 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 10:57:32.468603 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05332d07-757b-490c-adc2-9b8e2de857d8 None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:57:32.470436 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f152669c-e65c-4815-af48-eb6ade08304b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:57:32.472222 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f152669c-e65c-4815-af48-eb6ade08304b None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:57:32.596415 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05332d07-757b-490c-adc2-9b8e2de857d8 None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:57:32.603225 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 88/183] 10.222.0.18 () {58 vars in 1282 bytes} [Thu Oct 13 10:57:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 409 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 13 10:57:32.610043 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f152669c-e65c-4815-af48-eb6ade08304b None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:57:32.637368 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:57:32.644569 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b6d13e-b74f-44fd-b35a-a0c8998a9385 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:57:32.645287 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b6d13e-b74f-44fd-b35a-a0c8998a9385 None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:32.645635 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b6d13e-b74f-44fd-b35a-a0c8998a9385 None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:32.645972 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b6d13e-b74f-44fd-b35a-a0c8998a9385 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:32.646798 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b6d13e-b74f-44fd-b35a-a0c8998a9385 None admin] RBAC: Adding query filter params (role.id=30a6d59262144d4d956f4d4207864030, scope.project.id=ab0fe3e4091a40ca831652b16957b46a, user.id=bf56d2d8d4234cc3a4312b3c49dce457) {{(pid=81533) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 10:57:32.647169 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b6d13e-b74f-44fd-b35a-a0c8998a9385 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:57:32.648666 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b6d13e-b74f-44fd-b35a-a0c8998a9385 None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:57:32.656038 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 96/184] 10.222.0.18 () {56 vars in 1374 bytes} [Thu Oct 13 10:57:32 2022] GET /identity/v3/role_assignments?user.id=bf56d2d8d4234cc3a4312b3c49dce457&scope.project.id=ab0fe3e4091a40ca831652b16957b46a&role.id=30a6d59262144d4d956f4d4207864030 => generated 608 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 10:57:32.785662 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f152669c-e65c-4815-af48-eb6ade08304b None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:57:32.823799 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da93ed71-3590-4909-9a68-f6cc896b2fe6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:57:32.824444 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da93ed71-3590-4909-9a68-f6cc896b2fe6 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:32.824725 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da93ed71-3590-4909-9a68-f6cc896b2fe6 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:32.825001 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da93ed71-3590-4909-9a68-f6cc896b2fe6 None admin] PATH_INFO: `/v3/projects/ab0fe3e4091a40ca831652b16957b46a` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:32.826163 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da93ed71-3590-4909-9a68-f6cc896b2fe6 None admin] RBAC: Authorizing `identity:get_project(project_id=ab0fe3e4091a40ca831652b16957b46a)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:57:32.827632 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da93ed71-3590-4909-9a68-f6cc896b2fe6 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:57:32.829300 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 89/185] 10.222.0.18 () {56 vars in 1186 bytes} [Thu Oct 13 10:57:32 2022] GET /identity/v3/projects/ab0fe3e4091a40ca831652b16957b46a => generated 302 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 13 10:57:32.835421 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b6d13e-b74f-44fd-b35a-a0c8998a9385 None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:57:32.861425 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:57:32.962397 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b6d13e-b74f-44fd-b35a-a0c8998a9385 None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:57:32.999332 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed68a57c-7523-4e0c-aa73-e7e1a9e532bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:57:32.999999 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed68a57c-7523-4e0c-aa73-e7e1a9e532bb None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:33.000282 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed68a57c-7523-4e0c-aa73-e7e1a9e532bb None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:33.000554 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed68a57c-7523-4e0c-aa73-e7e1a9e532bb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:33.001442 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed68a57c-7523-4e0c-aa73-e7e1a9e532bb None admin] RBAC: Adding query filter params (role.id=e49be8727cbd4a39b3fbe6925f5af415, scope.project.id=ab0fe3e4091a40ca831652b16957b46a, user.id=bf56d2d8d4234cc3a4312b3c49dce457) {{(pid=81533) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 10:57:33.001801 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed68a57c-7523-4e0c-aa73-e7e1a9e532bb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:57:33.003253 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed68a57c-7523-4e0c-aa73-e7e1a9e532bb None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:57:33.009501 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 97/186] 10.222.0.18 () {56 vars in 1374 bytes} [Thu Oct 13 10:57:32 2022] GET /identity/v3/role_assignments?user.id=bf56d2d8d4234cc3a4312b3c49dce457&scope.project.id=ab0fe3e4091a40ca831652b16957b46a&role.id=e49be8727cbd4a39b3fbe6925f5af415 => generated 608 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 10:57:33.640962 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cff587-5f99-4b72-9c5c-4b0996ae922d None None] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:33.641503 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cff587-5f99-4b72-9c5c-4b0996ae922d None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:33.641579 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cff587-5f99-4b72-9c5c-4b0996ae922d None None] PATH_INFO: `/` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:33.642907 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 90/187] 10.222.0.18 () {54 vars in 927 bytes} [Thu Oct 13 10:57:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 10:57:33.648142 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff57e9a-07d6-45ef-a3f6-b0547cf8fbb3 None None] REQUEST_METHOD: `POST` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:33.648636 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff57e9a-07d6-45ef-a3f6-b0547cf8fbb3 None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:33.648712 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff57e9a-07d6-45ef-a3f6-b0547cf8fbb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:33.668939 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.auth.core [None req-8ff57e9a-07d6-45ef-a3f6-b0547cf8fbb3 None None] MFA Rules not processed for user `8ba31ade43694cf8bf28f7528a9ea179`. Rule list: `[]` (Enabled: `True`). {{(pid=81533) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 10:57:33.670213 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-8ff57e9a-07d6-45ef-a3f6-b0547cf8fbb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 10:57:33.747934 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 98/188] 10.222.0.18 () {58 vars in 1024 bytes} [Thu Oct 13 10:57:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 13 10:57:33.779128 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec4b59d-6c59-4b0a-8f9b-ab16e56e22e5 None None] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:33.779494 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec4b59d-6c59-4b0a-8f9b-ab16e56e22e5 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:33.779862 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec4b59d-6c59-4b0a-8f9b-ab16e56e22e5 None None] PATH_INFO: `/` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:33.781347 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 91/189] 10.222.0.18 () {54 vars in 927 bytes} [Thu Oct 13 10:57:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 10:57:33.786621 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c51f5a5-186c-4c5b-9b37-451cf084d230 None None] REQUEST_METHOD: `POST` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:33.786904 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c51f5a5-186c-4c5b-9b37-451cf084d230 None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:33.787171 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c51f5a5-186c-4c5b-9b37-451cf084d230 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:33.806302 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.auth.core [None req-0c51f5a5-186c-4c5b-9b37-451cf084d230 None None] MFA Rules not processed for user `8ba31ade43694cf8bf28f7528a9ea179`. Rule list: `[]` (Enabled: `True`). {{(pid=81533) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 10:57:33.808375 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-0c51f5a5-186c-4c5b-9b37-451cf084d230 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 10:57:33.816181 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:57:33.877197 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 99/190] 10.222.0.18 () {58 vars in 1024 bytes} [Thu Oct 13 10:57:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 13 10:57:34.017753 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec4b59d-6c59-4b0a-8f9b-ab16e56e22e5 None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:57:34.103144 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:57:34.123090 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec4b59d-6c59-4b0a-8f9b-ab16e56e22e5 None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:57:34.147021 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c51f5a5-186c-4c5b-9b37-451cf084d230 None None] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:57:34.160931 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb715faa-22c9-4e35-90b6-4f1aebafc364 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:57:34.161846 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb715faa-22c9-4e35-90b6-4f1aebafc364 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:34.162126 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb715faa-22c9-4e35-90b6-4f1aebafc364 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:34.162864 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb715faa-22c9-4e35-90b6-4f1aebafc364 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:34.164221 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb715faa-22c9-4e35-90b6-4f1aebafc364 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:57:34.166342 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb715faa-22c9-4e35-90b6-4f1aebafc364 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:57:34.168075 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 92/191] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Oct 13 10:57:34 2022] GET /identity/v3/domains/default => generated 199 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 10:57:34.173589 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb715faa-22c9-4e35-90b6-4f1aebafc364 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:57:34.252539 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c51f5a5-186c-4c5b-9b37-451cf084d230 None None] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:57:34.283312 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb715faa-22c9-4e35-90b6-4f1aebafc364 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:57:34.288956 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4168603f-80bd-435c-8e5e-c5a051351f4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:57:34.289606 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4168603f-80bd-435c-8e5e-c5a051351f4c None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:34.289881 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4168603f-80bd-435c-8e5e-c5a051351f4c None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:34.290148 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4168603f-80bd-435c-8e5e-c5a051351f4c None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:34.302909 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4168603f-80bd-435c-8e5e-c5a051351f4c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 13 10:57:34.309116 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application [None req-4168603f-80bd-435c-8e5e-c5a051351f4c None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 13 10:57:34.309116 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 10:57:34.309116 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 10:57:34.309116 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 10:57:34.309116 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 10:57:34.309116 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 10:57:34.309116 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 10:57:34.309116 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 10:57:34.309116 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 10:57:34.309116 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 10:57:34.309116 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 10:57:34.309116 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 10:57:34.309116 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 13 10:57:34.309116 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 13 10:57:34.309116 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 13 10:57:34.309116 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 13 10:57:34.310216 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 13 10:57:34.310216 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 13 10:57:34.310216 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 13 10:57:34.310216 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 13 10:57:34.310216 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 10:57:34.310216 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 10:57:34.310216 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 10:57:34.310216 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 10:57:34.310216 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 10:57:34.310216 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 10:57:34.310216 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 10:57:34.310216 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application with Lock( Oct 13 10:57:34.310216 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 10:57:34.310216 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._enter() Oct 13 10:57:34.310216 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 10:57:34.310216 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 10:57:34.311090 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 10:57:34.311090 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.creator() Oct 13 10:57:34.311090 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 10:57:34.311090 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application created_value = creator( Oct 13 10:57:34.311090 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 13 10:57:34.311090 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 13 10:57:34.311090 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 13 10:57:34.311090 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 13 10:57:34.311090 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 13 10:57:34.311090 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 13 10:57:34.311090 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 13 10:57:34.311090 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application Oct 13 10:57:34.311090 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 100/192] 10.222.0.18 () {56 vars in 1099 bytes} [Thu Oct 13 10:57:34 2022] GET /identity/v3/roles/reader => generated 84 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 13 10:57:34.316452 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4168603f-80bd-435c-8e5e-c5a051351f4c None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:57:34.320366 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:57:34.321548 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96be2377-995d-4940-ba09-e2f054bfa4af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:57:34.322187 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96be2377-995d-4940-ba09-e2f054bfa4af None admin] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:34.322488 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96be2377-995d-4940-ba09-e2f054bfa4af None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:34.323020 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96be2377-995d-4940-ba09-e2f054bfa4af None admin] PATH_INFO: `/v3/users` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:34.323883 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96be2377-995d-4940-ba09-e2f054bfa4af None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:57:34.325345 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96be2377-995d-4940-ba09-e2f054bfa4af None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:57:34.346649 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 93/193] 10.222.0.18 () {60 vars in 1132 bytes} [Thu Oct 13 10:57:34 2022] POST /identity/v3/users => generated 293 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 13 10:57:34.441119 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4168603f-80bd-435c-8e5e-c5a051351f4c None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:57:34.479239 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a972314-36df-4f69-936b-f87110f13645 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:57:34.480283 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a972314-36df-4f69-936b-f87110f13645 None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:34.480840 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a972314-36df-4f69-936b-f87110f13645 None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:34.481338 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a972314-36df-4f69-936b-f87110f13645 None admin] PATH_INFO: `/v3/roles` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:34.482256 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a972314-36df-4f69-936b-f87110f13645 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81533) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 10:57:34.482765 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a972314-36df-4f69-936b-f87110f13645 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:57:34.484421 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a972314-36df-4f69-936b-f87110f13645 None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:57:34.494610 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 101/194] 10.222.0.18 () {56 vars in 1101 bytes} [Thu Oct 13 10:57:34 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 13 10:57:34.500753 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96be2377-995d-4940-ba09-e2f054bfa4af None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:57:34.512199 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:57:34.618149 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96be2377-995d-4940-ba09-e2f054bfa4af None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:57:34.657311 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0d8eb8-0c0e-4c73-bbea-4db834daaff8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:57:34.657942 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0d8eb8-0c0e-4c73-bbea-4db834daaff8 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:34.658268 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0d8eb8-0c0e-4c73-bbea-4db834daaff8 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:34.658497 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0d8eb8-0c0e-4c73-bbea-4db834daaff8 None admin] PATH_INFO: `/v3/users/c26658b8144f434cb6ce96af0c89f761` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:34.661856 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354ebebc-28b6-4783-a035-0cf74085b4b2 None None] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:34.662691 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354ebebc-28b6-4783-a035-0cf74085b4b2 None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:34.663157 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354ebebc-28b6-4783-a035-0cf74085b4b2 None None] PATH_INFO: `/` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:34.664514 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 102/195] 10.222.0.18 () {54 vars in 927 bytes} [Thu Oct 13 10:57:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 13 10:57:34.670179 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e95b90-11c4-4fd7-8a60-41d2ec3ae0c6 None None] REQUEST_METHOD: `POST` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:34.670464 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e95b90-11c4-4fd7-8a60-41d2ec3ae0c6 None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:34.670834 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e95b90-11c4-4fd7-8a60-41d2ec3ae0c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:34.673587 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0d8eb8-0c0e-4c73-bbea-4db834daaff8 None admin] RBAC: Authorizing `identity:get_user(user_id=c26658b8144f434cb6ce96af0c89f761)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:57:34.675062 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0d8eb8-0c0e-4c73-bbea-4db834daaff8 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:57:34.677199 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 94/196] 10.222.0.18 () {56 vars in 1177 bytes} [Thu Oct 13 10:57:34 2022] GET /identity/v3/users/c26658b8144f434cb6ce96af0c89f761 => generated 297 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 10:57:34.683892 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0d8eb8-0c0e-4c73-bbea-4db834daaff8 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:57:34.694720 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.auth.core [None req-c4e95b90-11c4-4fd7-8a60-41d2ec3ae0c6 None None] MFA Rules not processed for user `8ba31ade43694cf8bf28f7528a9ea179`. Rule list: `[]` (Enabled: `True`). {{(pid=81533) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 10:57:34.696847 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-c4e95b90-11c4-4fd7-8a60-41d2ec3ae0c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 10:57:34.755155 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:57:34.779825 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 103/197] 10.222.0.18 () {58 vars in 1024 bytes} [Thu Oct 13 10:57:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 13 10:57:34.780374 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:57:34.801226 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0d8eb8-0c0e-4c73-bbea-4db834daaff8 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:57:34.837046 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d874e6a2-74ce-4db4-902c-294107c94cf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:57:34.837743 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d874e6a2-74ce-4db4-902c-294107c94cf4 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:34.838018 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d874e6a2-74ce-4db4-902c-294107c94cf4 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:34.838297 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d874e6a2-74ce-4db4-902c-294107c94cf4 None admin] PATH_INFO: `/v3/projects/ab0fe3e4091a40ca831652b16957b46a` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:34.839414 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d874e6a2-74ce-4db4-902c-294107c94cf4 None admin] RBAC: Authorizing `identity:get_project(project_id=ab0fe3e4091a40ca831652b16957b46a)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:57:34.840961 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d874e6a2-74ce-4db4-902c-294107c94cf4 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:57:34.842917 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 95/198] 10.222.0.18 () {56 vars in 1186 bytes} [Thu Oct 13 10:57:34 2022] GET /identity/v3/projects/ab0fe3e4091a40ca831652b16957b46a => generated 302 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 13 10:57:34.848558 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e95b90-11c4-4fd7-8a60-41d2ec3ae0c6 None None] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:57:34.951364 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e95b90-11c4-4fd7-8a60-41d2ec3ae0c6 None None] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:57:34.985906 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d8ed3e-483b-490b-b448-effb5e67c953 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:57:34.986826 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d8ed3e-483b-490b-b448-effb5e67c953 None admin] REQUEST_METHOD: `PUT` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:34.987241 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d8ed3e-483b-490b-b448-effb5e67c953 None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:34.987650 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d8ed3e-483b-490b-b448-effb5e67c953 None admin] PATH_INFO: `/v3/projects/ab0fe3e4091a40ca831652b16957b46a/users/c26658b8144f434cb6ce96af0c89f761/roles/f0789756c6f1413090292bae8bd8df5a` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:34.989703 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d8ed3e-483b-490b-b448-effb5e67c953 None admin] RBAC: Authorizing `identity:create_grant(project_id=ab0fe3e4091a40ca831652b16957b46a, user_id=c26658b8144f434cb6ce96af0c89f761, role_id=f0789756c6f1413090292bae8bd8df5a)` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:57:34.991276 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d8ed3e-483b-490b-b448-effb5e67c953 None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:57:35.010900 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 104/199] 10.222.0.18 () {58 vars in 1439 bytes} [Thu Oct 13 10:57:34 2022] PUT /identity/v3/projects/ab0fe3e4091a40ca831652b16957b46a/users/c26658b8144f434cb6ce96af0c89f761/roles/f0789756c6f1413090292bae8bd8df5a => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 10:57:35.075961 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d874e6a2-74ce-4db4-902c-294107c94cf4 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:57:35.187335 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d874e6a2-74ce-4db4-902c-294107c94cf4 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:57:35.218334 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:57:35.223539 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85dd3ff6-c4c9-4128-8d0a-7611d462eff5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:57:35.224175 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85dd3ff6-c4c9-4128-8d0a-7611d462eff5 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:35.224473 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85dd3ff6-c4c9-4128-8d0a-7611d462eff5 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:35.224726 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85dd3ff6-c4c9-4128-8d0a-7611d462eff5 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:35.236213 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85dd3ff6-c4c9-4128-8d0a-7611d462eff5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 13 10:57:35.242113 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application [None req-85dd3ff6-c4c9-4128-8d0a-7611d462eff5 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 13 10:57:35.242113 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 10:57:35.242113 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 10:57:35.242113 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 10:57:35.242113 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 10:57:35.242113 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 10:57:35.242113 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 10:57:35.242113 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 10:57:35.242113 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 10:57:35.242113 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 10:57:35.242113 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 10:57:35.242113 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 10:57:35.242113 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 13 10:57:35.242113 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 13 10:57:35.242113 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 13 10:57:35.242113 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 13 10:57:35.243020 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 13 10:57:35.243020 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 13 10:57:35.243020 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 13 10:57:35.243020 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 13 10:57:35.243020 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 10:57:35.243020 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 10:57:35.243020 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 10:57:35.243020 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 10:57:35.243020 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 10:57:35.243020 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 10:57:35.243020 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 10:57:35.243020 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application with Lock( Oct 13 10:57:35.243020 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 10:57:35.243020 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._enter() Oct 13 10:57:35.243020 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 10:57:35.243020 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 10:57:35.244376 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 10:57:35.244376 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.creator() Oct 13 10:57:35.244376 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 10:57:35.244376 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application created_value = creator( Oct 13 10:57:35.244376 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 13 10:57:35.244376 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 13 10:57:35.244376 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 13 10:57:35.244376 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 13 10:57:35.244376 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 13 10:57:35.244376 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 13 10:57:35.244376 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 13 10:57:35.244376 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application Oct 13 10:57:35.244376 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 96/200] 10.222.0.18 () {56 vars in 1099 bytes} [Thu Oct 13 10:57:35 2022] GET /identity/v3/roles/member => generated 84 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 10:57:35.250827 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d8ed3e-483b-490b-b448-effb5e67c953 None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:57:35.308383 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:57:35.355146 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d8ed3e-483b-490b-b448-effb5e67c953 None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:57:35.390863 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad78a80-ccc4-4a29-810d-fe38efe5b289 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:57:35.391857 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad78a80-ccc4-4a29-810d-fe38efe5b289 None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:35.392336 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad78a80-ccc4-4a29-810d-fe38efe5b289 None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:35.392806 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad78a80-ccc4-4a29-810d-fe38efe5b289 None admin] PATH_INFO: `/v3/roles` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:35.393700 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad78a80-ccc4-4a29-810d-fe38efe5b289 None admin] RBAC: Adding query filter params (name=member) {{(pid=81533) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 10:57:35.394219 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad78a80-ccc4-4a29-810d-fe38efe5b289 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:57:35.395799 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad78a80-ccc4-4a29-810d-fe38efe5b289 None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:57:35.405563 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 105/201] 10.222.0.18 () {56 vars in 1101 bytes} [Thu Oct 13 10:57:35 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 10:57:35.411011 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85dd3ff6-c4c9-4128-8d0a-7611d462eff5 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:57:35.520202 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85dd3ff6-c4c9-4128-8d0a-7611d462eff5 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:57:35.554699 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9818c886-4166-4824-a1c5-e30cc4a9b6fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:57:35.555328 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9818c886-4166-4824-a1c5-e30cc4a9b6fc None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:35.555606 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9818c886-4166-4824-a1c5-e30cc4a9b6fc None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:35.555877 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9818c886-4166-4824-a1c5-e30cc4a9b6fc None admin] PATH_INFO: `/v3/users/1836bcab3e2d4c8babc7eb259e42569e` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:35.557175 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9818c886-4166-4824-a1c5-e30cc4a9b6fc None admin] RBAC: Authorizing `identity:get_user(user_id=1836bcab3e2d4c8babc7eb259e42569e)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:57:35.558638 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9818c886-4166-4824-a1c5-e30cc4a9b6fc None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:57:35.560217 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 97/202] 10.222.0.18 () {56 vars in 1177 bytes} [Thu Oct 13 10:57:35 2022] GET /identity/v3/users/1836bcab3e2d4c8babc7eb259e42569e => generated 297 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 10:57:35.569119 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad78a80-ccc4-4a29-810d-fe38efe5b289 None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:57:35.677998 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad78a80-ccc4-4a29-810d-fe38efe5b289 None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:57:35.694685 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:57:35.714441 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d341b58e-2b13-4d92-8efa-b6cb005fc28a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:57:35.715063 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d341b58e-2b13-4d92-8efa-b6cb005fc28a None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:35.715342 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d341b58e-2b13-4d92-8efa-b6cb005fc28a None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:35.715618 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d341b58e-2b13-4d92-8efa-b6cb005fc28a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:35.787273 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d341b58e-2b13-4d92-8efa-b6cb005fc28a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:57:35.788668 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d341b58e-2b13-4d92-8efa-b6cb005fc28a None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:57:35.891835 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 106/203] 10.222.0.18 () {58 vars in 1282 bytes} [Thu Oct 13 10:57:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 13 10:57:35.897871 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9818c886-4166-4824-a1c5-e30cc4a9b6fc None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:57:35.959591 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:57:36.004921 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9818c886-4166-4824-a1c5-e30cc4a9b6fc None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:57:36.039813 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c6d346-70bf-4a16-855b-29576fd816e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:57:36.040376 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c6d346-70bf-4a16-855b-29576fd816e1 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:36.040739 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c6d346-70bf-4a16-855b-29576fd816e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:36.041041 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c6d346-70bf-4a16-855b-29576fd816e1 None admin] PATH_INFO: `/v3/projects/ab0fe3e4091a40ca831652b16957b46a` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:36.042287 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c6d346-70bf-4a16-855b-29576fd816e1 None admin] RBAC: Authorizing `identity:get_project(project_id=ab0fe3e4091a40ca831652b16957b46a)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:57:36.043722 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c6d346-70bf-4a16-855b-29576fd816e1 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:57:36.049170 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 98/204] 10.222.0.18 () {56 vars in 1186 bytes} [Thu Oct 13 10:57:35 2022] GET /identity/v3/projects/ab0fe3e4091a40ca831652b16957b46a => generated 302 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 10:57:36.051644 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d341b58e-2b13-4d92-8efa-b6cb005fc28a None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:57:36.069184 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:57:36.153070 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d341b58e-2b13-4d92-8efa-b6cb005fc28a None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:57:36.192492 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc51d667-20a8-478b-a332-c3a58d4cd15e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:57:36.193485 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc51d667-20a8-478b-a332-c3a58d4cd15e None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:36.193968 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc51d667-20a8-478b-a332-c3a58d4cd15e None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:36.194440 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc51d667-20a8-478b-a332-c3a58d4cd15e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:36.195382 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc51d667-20a8-478b-a332-c3a58d4cd15e None admin] RBAC: Adding query filter params (role.id=a893cd4f751e445aab4dda1a832f24a1, scope.project.id=ab0fe3e4091a40ca831652b16957b46a, user.id=1836bcab3e2d4c8babc7eb259e42569e) {{(pid=81533) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 10:57:36.195893 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc51d667-20a8-478b-a332-c3a58d4cd15e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:57:36.197644 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc51d667-20a8-478b-a332-c3a58d4cd15e None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:57:36.203805 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 107/205] 10.222.0.18 () {56 vars in 1374 bytes} [Thu Oct 13 10:57:36 2022] GET /identity/v3/role_assignments?user.id=1836bcab3e2d4c8babc7eb259e42569e&scope.project.id=ab0fe3e4091a40ca831652b16957b46a&role.id=a893cd4f751e445aab4dda1a832f24a1 => generated 608 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 10:57:36.767012 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c212a3fa-d90b-4f4c-8161-a2cf49ccf9dd None None] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:36.767321 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c212a3fa-d90b-4f4c-8161-a2cf49ccf9dd None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:36.767564 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c212a3fa-d90b-4f4c-8161-a2cf49ccf9dd None None] PATH_INFO: `/` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:36.769054 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 99/206] 10.222.0.18 () {54 vars in 927 bytes} [Thu Oct 13 10:57:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 10:57:36.774111 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a30bd8-c698-4d2b-ab46-6ef4b98ec5e2 None None] REQUEST_METHOD: `POST` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:36.774554 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a30bd8-c698-4d2b-ab46-6ef4b98ec5e2 None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:36.774730 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a30bd8-c698-4d2b-ab46-6ef4b98ec5e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:36.791702 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efea8391-a72c-444e-a33d-eeca609b36e2 None None] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:36.792011 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efea8391-a72c-444e-a33d-eeca609b36e2 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:36.792254 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efea8391-a72c-444e-a33d-eeca609b36e2 None None] PATH_INFO: `/` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:36.792826 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.auth.core [None req-33a30bd8-c698-4d2b-ab46-6ef4b98ec5e2 None None] MFA Rules not processed for user `8ba31ade43694cf8bf28f7528a9ea179`. Rule list: `[]` (Enabled: `True`). {{(pid=81533) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 10:57:36.793735 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 100/207] 10.222.0.18 () {54 vars in 927 bytes} [Thu Oct 13 10:57:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 13 10:57:36.794039 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-33a30bd8-c698-4d2b-ab46-6ef4b98ec5e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 10:57:36.798622 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9115a8-5ef4-452a-8ae2-18c659e91f7e None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:36.798906 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9115a8-5ef4-452a-8ae2-18c659e91f7e None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:36.799183 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9115a8-5ef4-452a-8ae2-18c659e91f7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:36.818099 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-4c9115a8-5ef4-452a-8ae2-18c659e91f7e None None] MFA Rules not processed for user `8ba31ade43694cf8bf28f7528a9ea179`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 10:57:36.819279 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-4c9115a8-5ef4-452a-8ae2-18c659e91f7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 10:57:36.867092 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 108/208] 10.222.0.18 () {58 vars in 1024 bytes} [Thu Oct 13 10:57:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 13 10:57:36.891391 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 101/209] 10.222.0.18 () {58 vars in 1024 bytes} [Thu Oct 13 10:57:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 13 10:57:37.137911 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a30bd8-c698-4d2b-ab46-6ef4b98ec5e2 None None] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:57:37.149841 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:57:37.160566 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9115a8-5ef4-452a-8ae2-18c659e91f7e None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:57:37.223315 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:57:37.252393 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a30bd8-c698-4d2b-ab46-6ef4b98ec5e2 None None] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:57:37.269583 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9115a8-5ef4-452a-8ae2-18c659e91f7e None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:57:37.288179 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729a7134-4993-4af7-bd4d-a5179e02db3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:57:37.288812 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729a7134-4993-4af7-bd4d-a5179e02db3e None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:37.289115 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729a7134-4993-4af7-bd4d-a5179e02db3e None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:37.289385 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729a7134-4993-4af7-bd4d-a5179e02db3e None admin] PATH_INFO: `/v3/domains/default` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:37.290479 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729a7134-4993-4af7-bd4d-a5179e02db3e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:57:37.291957 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729a7134-4993-4af7-bd4d-a5179e02db3e None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:57:37.293775 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 109/210] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Oct 13 10:57:37 2022] GET /identity/v3/domains/default => generated 199 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 10:57:37.298960 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a2c440-a9c2-468f-a769-9c0a74964482 None None] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:37.299248 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a2c440-a9c2-468f-a769-9c0a74964482 None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:37.299518 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a2c440-a9c2-468f-a769-9c0a74964482 None None] PATH_INFO: `/` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:37.300755 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 110/211] 10.222.0.18 () {54 vars in 927 bytes} [Thu Oct 13 10:57:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 13 10:57:37.301469 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a2c440-a9c2-468f-a769-9c0a74964482 None None] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:57:37.306810 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6445ed5-f5ac-4428-bdaf-b63be6fa84ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:57:37.307445 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6445ed5-f5ac-4428-bdaf-b63be6fa84ce None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:37.307725 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6445ed5-f5ac-4428-bdaf-b63be6fa84ce None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:37.307999 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6445ed5-f5ac-4428-bdaf-b63be6fa84ce None admin] PATH_INFO: `/v3/roles/member` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:37.318569 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6445ed5-f5ac-4428-bdaf-b63be6fa84ce None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 13 10:57:37.324175 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application [None req-f6445ed5-f5ac-4428-bdaf-b63be6fa84ce None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 13 10:57:37.324175 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 10:57:37.324175 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 10:57:37.324175 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 10:57:37.324175 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 10:57:37.324175 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 10:57:37.324175 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 10:57:37.324175 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 10:57:37.324175 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 10:57:37.324175 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 10:57:37.324175 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 10:57:37.324175 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 10:57:37.324175 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 13 10:57:37.324175 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 13 10:57:37.324175 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 13 10:57:37.324175 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 13 10:57:37.325262 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 13 10:57:37.325262 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 13 10:57:37.325262 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 13 10:57:37.325262 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 13 10:57:37.325262 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 10:57:37.325262 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 10:57:37.325262 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 10:57:37.325262 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 10:57:37.325262 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 10:57:37.325262 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 10:57:37.325262 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 10:57:37.325262 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application with Lock( Oct 13 10:57:37.325262 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 10:57:37.325262 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._enter() Oct 13 10:57:37.325262 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 10:57:37.325262 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 10:57:37.329899 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 10:57:37.329899 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.creator() Oct 13 10:57:37.329899 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 10:57:37.329899 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application created_value = creator( Oct 13 10:57:37.329899 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 13 10:57:37.329899 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 13 10:57:37.329899 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 13 10:57:37.329899 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 13 10:57:37.329899 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 13 10:57:37.329899 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 13 10:57:37.329899 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 13 10:57:37.329899 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application Oct 13 10:57:37.329899 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 102/212] 10.222.0.18 () {56 vars in 1099 bytes} [Thu Oct 13 10:57:37 2022] GET /identity/v3/roles/member => generated 84 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 13 10:57:37.329899 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a33b379-ab4c-4975-9a60-87b82a2a87d3 None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:37.330607 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a33b379-ab4c-4975-9a60-87b82a2a87d3 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:37.330607 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a33b379-ab4c-4975-9a60-87b82a2a87d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:37.345724 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-4a33b379-ab4c-4975-9a60-87b82a2a87d3 None None] MFA Rules not processed for user `8ba31ade43694cf8bf28f7528a9ea179`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 10:57:37.347268 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-4a33b379-ab4c-4975-9a60-87b82a2a87d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 10:57:37.385134 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:57:37.407830 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a2c440-a9c2-468f-a769-9c0a74964482 None None] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:57:37.414228 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 103/213] 10.222.0.18 () {58 vars in 1024 bytes} [Thu Oct 13 10:57:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 13 10:57:37.421995 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a33b379-ab4c-4975-9a60-87b82a2a87d3 None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:57:37.443651 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20bf533-f6fe-41a0-8a72-a92b8fc85dd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:57:37.444483 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20bf533-f6fe-41a0-8a72-a92b8fc85dd6 None admin] REQUEST_METHOD: `POST` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:37.444762 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20bf533-f6fe-41a0-8a72-a92b8fc85dd6 None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:37.445054 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20bf533-f6fe-41a0-8a72-a92b8fc85dd6 None admin] PATH_INFO: `/v3/users` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:37.445708 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e20bf533-f6fe-41a0-8a72-a92b8fc85dd6 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:57:37.447688 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e20bf533-f6fe-41a0-8a72-a92b8fc85dd6 None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:57:37.470284 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 111/214] 10.222.0.18 () {60 vars in 1132 bytes} [Thu Oct 13 10:57:37 2022] POST /identity/v3/users => generated 293 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 13 10:57:37.473278 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:57:37.531238 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a33b379-ab4c-4975-9a60-87b82a2a87d3 None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:57:37.571104 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16948c10-732c-4e9b-93cc-b6ad2fdf940a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:57:37.572737 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16948c10-732c-4e9b-93cc-b6ad2fdf940a None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:37.573268 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16948c10-732c-4e9b-93cc-b6ad2fdf940a None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:37.573728 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16948c10-732c-4e9b-93cc-b6ad2fdf940a None admin] PATH_INFO: `/v3/roles` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:37.574566 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16948c10-732c-4e9b-93cc-b6ad2fdf940a None admin] RBAC: Adding query filter params (name=member) {{(pid=81534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 10:57:37.575050 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16948c10-732c-4e9b-93cc-b6ad2fdf940a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:57:37.576569 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16948c10-732c-4e9b-93cc-b6ad2fdf940a None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:57:37.594635 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 104/215] 10.222.0.18 () {56 vars in 1101 bytes} [Thu Oct 13 10:57:37 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 10:57:37.595956 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20bf533-f6fe-41a0-8a72-a92b8fc85dd6 None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:57:37.686839 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16948c10-732c-4e9b-93cc-b6ad2fdf940a None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:57:37.708258 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20bf533-f6fe-41a0-8a72-a92b8fc85dd6 None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:57:37.751952 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f80fc6b-76e4-494e-ab02-7342af66d25c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:57:37.753000 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f80fc6b-76e4-494e-ab02-7342af66d25c None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:37.753601 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f80fc6b-76e4-494e-ab02-7342af66d25c None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:37.754079 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f80fc6b-76e4-494e-ab02-7342af66d25c None admin] PATH_INFO: `/v3/users/969112bcc8bd40feafd70f73ef79b10d` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:37.758453 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:57:37.778680 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f80fc6b-76e4-494e-ab02-7342af66d25c None admin] RBAC: Authorizing `identity:get_user(user_id=969112bcc8bd40feafd70f73ef79b10d)` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:57:37.780181 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f80fc6b-76e4-494e-ab02-7342af66d25c None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:57:37.781926 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 112/216] 10.222.0.18 () {56 vars in 1177 bytes} [Thu Oct 13 10:57:37 2022] GET /identity/v3/users/969112bcc8bd40feafd70f73ef79b10d => generated 293 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 10:57:37.788320 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f80fc6b-76e4-494e-ab02-7342af66d25c None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:57:37.818751 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16948c10-732c-4e9b-93cc-b6ad2fdf940a None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:57:37.832700 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:57:37.863478 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9fd35a-0b60-4300-bc32-99fb78bfdf1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:57:37.864149 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9fd35a-0b60-4300-bc32-99fb78bfdf1c None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:37.864431 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9fd35a-0b60-4300-bc32-99fb78bfdf1c None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:37.864703 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9fd35a-0b60-4300-bc32-99fb78bfdf1c None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:37.876473 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9fd35a-0b60-4300-bc32-99fb78bfdf1c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 13 10:57:37.882310 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application [None req-ee9fd35a-0b60-4300-bc32-99fb78bfdf1c None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 13 10:57:37.882310 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 10:57:37.882310 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 10:57:37.882310 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 10:57:37.882310 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 10:57:37.882310 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 10:57:37.882310 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 10:57:37.882310 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 10:57:37.882310 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 10:57:37.882310 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 10:57:37.882310 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 10:57:37.882310 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 10:57:37.882310 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 13 10:57:37.882310 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 13 10:57:37.882310 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 13 10:57:37.882310 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 13 10:57:37.883233 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 13 10:57:37.883233 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 13 10:57:37.883233 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 13 10:57:37.883233 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 13 10:57:37.883233 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 10:57:37.883233 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 10:57:37.883233 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 10:57:37.883233 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 10:57:37.883233 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 10:57:37.883233 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 10:57:37.883233 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 10:57:37.883233 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application with Lock( Oct 13 10:57:37.883233 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 10:57:37.883233 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._enter() Oct 13 10:57:37.883233 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 10:57:37.883233 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 10:57:37.884035 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 10:57:37.884035 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.creator() Oct 13 10:57:37.884035 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 10:57:37.884035 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application created_value = creator( Oct 13 10:57:37.884035 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 13 10:57:37.884035 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 13 10:57:37.884035 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 13 10:57:37.884035 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 13 10:57:37.884035 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 13 10:57:37.884035 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 13 10:57:37.884035 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 13 10:57:37.884035 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application Oct 13 10:57:37.884035 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 105/217] 10.222.0.18 () {56 vars in 1099 bytes} [Thu Oct 13 10:57:37 2022] GET /identity/v3/roles/reader => generated 84 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 10:57:37.890033 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9fd35a-0b60-4300-bc32-99fb78bfdf1c None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:57:37.911592 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f80fc6b-76e4-494e-ab02-7342af66d25c None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:57:37.959852 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b731e66-951e-4346-bb89-46c3fa2aed7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:57:37.960378 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b731e66-951e-4346-bb89-46c3fa2aed7a None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:37.960653 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b731e66-951e-4346-bb89-46c3fa2aed7a None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:37.960921 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b731e66-951e-4346-bb89-46c3fa2aed7a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:37.961897 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b731e66-951e-4346-bb89-46c3fa2aed7a None admin] RBAC: Adding query filter params (role.id=a893cd4f751e445aab4dda1a832f24a1, user.id=969112bcc8bd40feafd70f73ef79b10d, scope.system=all) {{(pid=81533) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 10:57:37.962204 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b731e66-951e-4346-bb89-46c3fa2aed7a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:57:37.965743 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b731e66-951e-4346-bb89-46c3fa2aed7a None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:57:37.975442 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 113/218] 10.222.0.18 () {56 vars in 1308 bytes} [Thu Oct 13 10:57:37 2022] GET /identity/v3/role_assignments?user.id=969112bcc8bd40feafd70f73ef79b10d&scope.system=all&role.id=a893cd4f751e445aab4dda1a832f24a1 => generated 226 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 13 10:57:38.016527 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9fd35a-0b60-4300-bc32-99fb78bfdf1c None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:57:38.057688 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3eac4c-f8a7-4c33-bf51-7dc2eb9f05d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:57:38.058424 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3eac4c-f8a7-4c33-bf51-7dc2eb9f05d1 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:38.058705 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3eac4c-f8a7-4c33-bf51-7dc2eb9f05d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:38.058977 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3eac4c-f8a7-4c33-bf51-7dc2eb9f05d1 None admin] PATH_INFO: `/v3/roles` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:38.059709 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3eac4c-f8a7-4c33-bf51-7dc2eb9f05d1 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 10:57:38.060017 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3eac4c-f8a7-4c33-bf51-7dc2eb9f05d1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:57:38.061464 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3eac4c-f8a7-4c33-bf51-7dc2eb9f05d1 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:57:38.071845 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 106/219] 10.222.0.18 () {56 vars in 1101 bytes} [Thu Oct 13 10:57:37 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 13 10:57:38.078443 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b731e66-951e-4346-bb89-46c3fa2aed7a None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:57:38.146572 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:57:38.194813 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b731e66-951e-4346-bb89-46c3fa2aed7a None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:57:38.229381 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb22c2f-5037-46ab-95a8-ea7ef4e94066 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:57:38.229931 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb22c2f-5037-46ab-95a8-ea7ef4e94066 None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:38.230210 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb22c2f-5037-46ab-95a8-ea7ef4e94066 None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:38.230479 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb22c2f-5037-46ab-95a8-ea7ef4e94066 None admin] PATH_INFO: `/v3/users/c26658b8144f434cb6ce96af0c89f761` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:38.231605 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb22c2f-5037-46ab-95a8-ea7ef4e94066 None admin] RBAC: Authorizing `identity:get_user(user_id=c26658b8144f434cb6ce96af0c89f761)` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:57:38.233058 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb22c2f-5037-46ab-95a8-ea7ef4e94066 None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:57:38.234648 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 114/220] 10.222.0.18 () {56 vars in 1177 bytes} [Thu Oct 13 10:57:38 2022] GET /identity/v3/users/c26658b8144f434cb6ce96af0c89f761 => generated 297 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 10:57:38.240188 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3eac4c-f8a7-4c33-bf51-7dc2eb9f05d1 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:57:38.276666 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:57:38.349444 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3eac4c-f8a7-4c33-bf51-7dc2eb9f05d1 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:57:38.386360 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f285f7-8388-4847-ba4d-a212f1e81a25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:57:38.386974 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f285f7-8388-4847-ba4d-a212f1e81a25 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:38.387314 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f285f7-8388-4847-ba4d-a212f1e81a25 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:38.387588 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f285f7-8388-4847-ba4d-a212f1e81a25 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:38.461481 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f285f7-8388-4847-ba4d-a212f1e81a25 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:57:38.463732 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f285f7-8388-4847-ba4d-a212f1e81a25 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:57:38.495528 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:57:38.573032 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 107/221] 10.222.0.18 () {58 vars in 1282 bytes} [Thu Oct 13 10:57:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 13 10:57:38.578874 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb22c2f-5037-46ab-95a8-ea7ef4e94066 None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:57:38.681902 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb22c2f-5037-46ab-95a8-ea7ef4e94066 None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:57:38.705561 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:57:38.717973 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8455780b-20a3-4c36-8b4d-a81a8cb44f52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:57:38.718853 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8455780b-20a3-4c36-8b4d-a81a8cb44f52 None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:38.719311 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8455780b-20a3-4c36-8b4d-a81a8cb44f52 None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:38.719759 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8455780b-20a3-4c36-8b4d-a81a8cb44f52 None admin] PATH_INFO: `/v3/projects/ab0fe3e4091a40ca831652b16957b46a` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:38.721129 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8455780b-20a3-4c36-8b4d-a81a8cb44f52 None admin] RBAC: Authorizing `identity:get_project(project_id=ab0fe3e4091a40ca831652b16957b46a)` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:57:38.722756 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8455780b-20a3-4c36-8b4d-a81a8cb44f52 None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:57:38.724886 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 115/222] 10.222.0.18 () {56 vars in 1186 bytes} [Thu Oct 13 10:57:38 2022] GET /identity/v3/projects/ab0fe3e4091a40ca831652b16957b46a => generated 302 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 10:57:38.735787 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f285f7-8388-4847-ba4d-a212f1e81a25 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:57:38.840875 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f285f7-8388-4847-ba4d-a212f1e81a25 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:57:38.871782 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:57:38.877269 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20fcd86-f9c6-4fcd-847a-1da551bc73b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:57:38.877876 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20fcd86-f9c6-4fcd-847a-1da551bc73b7 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:38.878154 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20fcd86-f9c6-4fcd-847a-1da551bc73b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:38.878425 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20fcd86-f9c6-4fcd-847a-1da551bc73b7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:38.879154 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e20fcd86-f9c6-4fcd-847a-1da551bc73b7 None admin] RBAC: Adding query filter params (role.id=f0789756c6f1413090292bae8bd8df5a, scope.project.id=ab0fe3e4091a40ca831652b16957b46a, user.id=c26658b8144f434cb6ce96af0c89f761) {{(pid=81534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 10:57:38.879463 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e20fcd86-f9c6-4fcd-847a-1da551bc73b7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:57:38.880900 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e20fcd86-f9c6-4fcd-847a-1da551bc73b7 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:57:38.887371 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 108/223] 10.222.0.18 () {56 vars in 1374 bytes} [Thu Oct 13 10:57:38 2022] GET /identity/v3/role_assignments?user.id=c26658b8144f434cb6ce96af0c89f761&scope.project.id=ab0fe3e4091a40ca831652b16957b46a&role.id=f0789756c6f1413090292bae8bd8df5a => generated 608 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 10:57:39.880269 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8f8cb6-53d1-4b5d-b559-b52d41ceb69a None None] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:39.880802 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8f8cb6-53d1-4b5d-b559-b52d41ceb69a None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:39.880802 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8f8cb6-53d1-4b5d-b559-b52d41ceb69a None None] PATH_INFO: `/` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:39.882607 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 116/224] 10.222.0.18 () {54 vars in 927 bytes} [Thu Oct 13 10:57:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 10:57:39.887101 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90861746-22af-48cf-a2d7-7ff6859b79ea None None] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:39.887524 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90861746-22af-48cf-a2d7-7ff6859b79ea None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:39.887600 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7e3c1a-9fe1-436f-9b40-79d99804b80e None None] REQUEST_METHOD: `POST` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:39.887670 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90861746-22af-48cf-a2d7-7ff6859b79ea None None] PATH_INFO: `/` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:39.887738 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7e3c1a-9fe1-436f-9b40-79d99804b80e None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:39.887928 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7e3c1a-9fe1-436f-9b40-79d99804b80e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:39.888959 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 109/225] 10.222.0.18 () {54 vars in 927 bytes} [Thu Oct 13 10:57:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 10:57:39.894018 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b372bc1-2339-4e6a-905f-77fc86755e2b None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:39.894450 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b372bc1-2339-4e6a-905f-77fc86755e2b None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:39.894861 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b372bc1-2339-4e6a-905f-77fc86755e2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:39.907085 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.auth.core [None req-df7e3c1a-9fe1-436f-9b40-79d99804b80e None None] MFA Rules not processed for user `8ba31ade43694cf8bf28f7528a9ea179`. Rule list: `[]` (Enabled: `True`). {{(pid=81533) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 10:57:39.908276 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-df7e3c1a-9fe1-436f-9b40-79d99804b80e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 10:57:39.914385 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-4b372bc1-2339-4e6a-905f-77fc86755e2b None None] MFA Rules not processed for user `8ba31ade43694cf8bf28f7528a9ea179`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 10:57:39.916378 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-4b372bc1-2339-4e6a-905f-77fc86755e2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 10:57:39.978230 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 117/226] 10.222.0.18 () {58 vars in 1024 bytes} [Thu Oct 13 10:57:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 13 10:57:39.995111 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 110/227] 10.222.0.18 () {58 vars in 1024 bytes} [Thu Oct 13 10:57:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 13 10:57:40.213915 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b07e5d-2f80-4213-aa08-67f7e09f9b65 None None] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:40.214280 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b07e5d-2f80-4213-aa08-67f7e09f9b65 None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:40.214534 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b07e5d-2f80-4213-aa08-67f7e09f9b65 None None] PATH_INFO: `/` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:40.216769 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 118/228] 10.222.0.18 () {54 vars in 927 bytes} [Thu Oct 13 10:57:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 10:57:40.221981 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3967b846-8b39-4995-b1d7-d459a29ca8f0 None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:40.222271 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3967b846-8b39-4995-b1d7-d459a29ca8f0 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:40.222552 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3967b846-8b39-4995-b1d7-d459a29ca8f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:40.243094 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-3967b846-8b39-4995-b1d7-d459a29ca8f0 None None] MFA Rules not processed for user `8ba31ade43694cf8bf28f7528a9ea179`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 10:57:40.244837 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-3967b846-8b39-4995-b1d7-d459a29ca8f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 10:57:40.248292 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b07e5d-2f80-4213-aa08-67f7e09f9b65 None None] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:57:40.318599 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 111/229] 10.222.0.18 () {58 vars in 1024 bytes} [Thu Oct 13 10:57:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 13 10:57:40.321249 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3967b846-8b39-4995-b1d7-d459a29ca8f0 None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:57:40.363060 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b07e5d-2f80-4213-aa08-67f7e09f9b65 None None] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:57:40.385683 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:57:40.389074 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:57:40.402983 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb96036-d34d-4472-a609-2cec8071172f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:57:40.403622 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb96036-d34d-4472-a609-2cec8071172f None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:40.403899 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb96036-d34d-4472-a609-2cec8071172f None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:40.404229 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb96036-d34d-4472-a609-2cec8071172f None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:40.417504 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb96036-d34d-4472-a609-2cec8071172f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 13 10:57:40.422538 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application [None req-5bb96036-d34d-4472-a609-2cec8071172f None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 13 10:57:40.422538 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 10:57:40.422538 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 10:57:40.422538 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 10:57:40.422538 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 10:57:40.422538 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 10:57:40.422538 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 10:57:40.422538 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 10:57:40.422538 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 10:57:40.422538 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 10:57:40.422538 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 10:57:40.422538 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 10:57:40.422538 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 13 10:57:40.422538 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 13 10:57:40.422538 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 13 10:57:40.422538 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 13 10:57:40.423442 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 13 10:57:40.423442 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 13 10:57:40.423442 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 13 10:57:40.423442 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 13 10:57:40.423442 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 10:57:40.423442 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 10:57:40.423442 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 10:57:40.423442 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 10:57:40.423442 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 10:57:40.423442 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 10:57:40.423442 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 10:57:40.423442 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application with Lock( Oct 13 10:57:40.423442 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 10:57:40.423442 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._enter() Oct 13 10:57:40.423442 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 10:57:40.423442 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 10:57:40.424260 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 10:57:40.424260 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.creator() Oct 13 10:57:40.424260 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 10:57:40.424260 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application created_value = creator( Oct 13 10:57:40.424260 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 13 10:57:40.424260 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 13 10:57:40.424260 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 13 10:57:40.424260 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 13 10:57:40.424260 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 13 10:57:40.424260 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 13 10:57:40.424260 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 13 10:57:40.424260 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application Oct 13 10:57:40.424260 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 119/230] 10.222.0.18 () {56 vars in 1099 bytes} [Thu Oct 13 10:57:40 2022] GET /identity/v3/roles/reader => generated 84 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 13 10:57:40.429392 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb96036-d34d-4472-a609-2cec8071172f None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:57:40.442985 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3967b846-8b39-4995-b1d7-d459a29ca8f0 None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:57:40.484333 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116a8846-c9fa-45e1-b20d-191b796ca75d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:57:40.484968 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116a8846-c9fa-45e1-b20d-191b796ca75d None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:40.485275 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116a8846-c9fa-45e1-b20d-191b796ca75d None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:40.485556 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116a8846-c9fa-45e1-b20d-191b796ca75d None admin] PATH_INFO: `/v3/domains/default` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:40.486667 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116a8846-c9fa-45e1-b20d-191b796ca75d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:57:40.488103 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116a8846-c9fa-45e1-b20d-191b796ca75d None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:57:40.489864 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 112/231] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Oct 13 10:57:40 2022] GET /identity/v3/domains/default => generated 199 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 10:57:40.497209 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116a8846-c9fa-45e1-b20d-191b796ca75d None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:57:40.551058 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb96036-d34d-4472-a609-2cec8071172f None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:57:40.592717 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931b8847-d36c-47d5-9545-750ead41de0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:57:40.593356 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931b8847-d36c-47d5-9545-750ead41de0d None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:40.593743 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931b8847-d36c-47d5-9545-750ead41de0d None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:40.594011 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931b8847-d36c-47d5-9545-750ead41de0d None admin] PATH_INFO: `/v3/roles` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:40.594677 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-931b8847-d36c-47d5-9545-750ead41de0d None admin] RBAC: Adding query filter params (name=reader) {{(pid=81533) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 10:57:40.594973 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-931b8847-d36c-47d5-9545-750ead41de0d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:57:40.596604 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-931b8847-d36c-47d5-9545-750ead41de0d None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:57:40.609046 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 120/232] 10.222.0.18 () {56 vars in 1101 bytes} [Thu Oct 13 10:57:40 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 13 10:57:40.614017 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931b8847-d36c-47d5-9545-750ead41de0d None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:57:40.617117 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116a8846-c9fa-45e1-b20d-191b796ca75d None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:57:40.643562 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:57:40.657998 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca83be4-996f-4c7b-b0f8-1f8e75adcdc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:57:40.659074 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca83be4-996f-4c7b-b0f8-1f8e75adcdc5 None admin] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:40.659351 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca83be4-996f-4c7b-b0f8-1f8e75adcdc5 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:40.659619 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca83be4-996f-4c7b-b0f8-1f8e75adcdc5 None admin] PATH_INFO: `/v3/groups` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:40.660255 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca83be4-996f-4c7b-b0f8-1f8e75adcdc5 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:57:40.661728 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca83be4-996f-4c7b-b0f8-1f8e75adcdc5 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:57:40.662602 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:57:40.679718 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 113/233] 10.222.0.18 () {60 vars in 1134 bytes} [Thu Oct 13 10:57:40 2022] POST /identity/v3/groups => generated 229 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 13 10:57:40.680946 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca83be4-996f-4c7b-b0f8-1f8e75adcdc5 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:57:40.759880 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931b8847-d36c-47d5-9545-750ead41de0d None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:57:40.811592 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ccde95-3042-4009-b26e-8bb7fed3b1ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:57:40.812717 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ccde95-3042-4009-b26e-8bb7fed3b1ce None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:40.814024 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ccde95-3042-4009-b26e-8bb7fed3b1ce None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:40.814523 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ccde95-3042-4009-b26e-8bb7fed3b1ce None admin] PATH_INFO: `/v3/roles/member` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:40.823692 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca83be4-996f-4c7b-b0f8-1f8e75adcdc5 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:57:40.829235 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ccde95-3042-4009-b26e-8bb7fed3b1ce None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 13 10:57:40.835786 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application [None req-42ccde95-3042-4009-b26e-8bb7fed3b1ce None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 13 10:57:40.835786 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 10:57:40.835786 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 10:57:40.835786 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 10:57:40.835786 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 10:57:40.835786 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 10:57:40.835786 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 10:57:40.835786 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 10:57:40.835786 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 10:57:40.835786 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 10:57:40.835786 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 10:57:40.835786 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 10:57:40.835786 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 13 10:57:40.835786 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 13 10:57:40.835786 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 13 10:57:40.835786 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 13 10:57:40.836956 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 13 10:57:40.836956 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 13 10:57:40.836956 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 13 10:57:40.836956 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 13 10:57:40.836956 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 10:57:40.836956 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 10:57:40.836956 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 10:57:40.836956 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 10:57:40.836956 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 10:57:40.836956 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 10:57:40.836956 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 10:57:40.836956 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application with Lock( Oct 13 10:57:40.836956 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 10:57:40.836956 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._enter() Oct 13 10:57:40.836956 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 10:57:40.836956 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 10:57:40.837899 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 10:57:40.837899 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.creator() Oct 13 10:57:40.837899 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 10:57:40.837899 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application created_value = creator( Oct 13 10:57:40.837899 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 13 10:57:40.837899 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 13 10:57:40.837899 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 13 10:57:40.837899 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 13 10:57:40.837899 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 13 10:57:40.837899 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 13 10:57:40.837899 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 13 10:57:40.837899 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application Oct 13 10:57:40.837899 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 121/234] 10.222.0.18 () {56 vars in 1099 bytes} [Thu Oct 13 10:57:40 2022] GET /identity/v3/roles/member => generated 84 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 13 10:57:40.844659 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ccde95-3042-4009-b26e-8bb7fed3b1ce None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:57:40.873569 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2780a88e-5f3a-4e24-a5b1-8c6650e303ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:57:40.874234 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2780a88e-5f3a-4e24-a5b1-8c6650e303ec None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:40.874606 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2780a88e-5f3a-4e24-a5b1-8c6650e303ec None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:40.874892 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2780a88e-5f3a-4e24-a5b1-8c6650e303ec None admin] PATH_INFO: `/v3/users/05fc2aa0266443cf9f993d9650aec909` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:40.894064 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2780a88e-5f3a-4e24-a5b1-8c6650e303ec None admin] RBAC: Authorizing `identity:get_user(user_id=05fc2aa0266443cf9f993d9650aec909)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:57:40.895725 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2780a88e-5f3a-4e24-a5b1-8c6650e303ec None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:57:40.898875 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 114/235] 10.222.0.18 () {56 vars in 1177 bytes} [Thu Oct 13 10:57:40 2022] GET /identity/v3/users/05fc2aa0266443cf9f993d9650aec909 => generated 293 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 10:57:40.904065 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2780a88e-5f3a-4e24-a5b1-8c6650e303ec None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:57:40.968940 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:57:40.973879 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ccde95-3042-4009-b26e-8bb7fed3b1ce None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:57:40.980476 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:57:41.016584 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5ef8dd-df7a-43f4-bafc-94f3c8285668 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:57:41.017229 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5ef8dd-df7a-43f4-bafc-94f3c8285668 None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:41.017513 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5ef8dd-df7a-43f4-bafc-94f3c8285668 None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:41.017781 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5ef8dd-df7a-43f4-bafc-94f3c8285668 None admin] PATH_INFO: `/v3/roles` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:41.018447 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5ef8dd-df7a-43f4-bafc-94f3c8285668 None admin] RBAC: Adding query filter params (name=member) {{(pid=81533) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 10:57:41.018757 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5ef8dd-df7a-43f4-bafc-94f3c8285668 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:57:41.020137 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5ef8dd-df7a-43f4-bafc-94f3c8285668 None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:57:41.028734 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 122/236] 10.222.0.18 () {56 vars in 1101 bytes} [Thu Oct 13 10:57:40 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 13 10:57:41.034032 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2780a88e-5f3a-4e24-a5b1-8c6650e303ec None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:57:41.034277 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5ef8dd-df7a-43f4-bafc-94f3c8285668 None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:57:41.070802 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f1882c-c8bc-4195-b026-de3ecb7f9594 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:57:41.071320 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f1882c-c8bc-4195-b026-de3ecb7f9594 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:41.071629 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f1882c-c8bc-4195-b026-de3ecb7f9594 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:41.071968 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f1882c-c8bc-4195-b026-de3ecb7f9594 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:41.072697 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f1882c-c8bc-4195-b026-de3ecb7f9594 None admin] RBAC: Adding query filter params (role.id=f0789756c6f1413090292bae8bd8df5a, user.id=05fc2aa0266443cf9f993d9650aec909, scope.system=all) {{(pid=81534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 10:57:41.073000 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f1882c-c8bc-4195-b026-de3ecb7f9594 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:57:41.074450 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f1882c-c8bc-4195-b026-de3ecb7f9594 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:57:41.080142 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 115/237] 10.222.0.18 () {56 vars in 1308 bytes} [Thu Oct 13 10:57:40 2022] GET /identity/v3/role_assignments?user.id=05fc2aa0266443cf9f993d9650aec909&scope.system=all&role.id=f0789756c6f1413090292bae8bd8df5a => generated 226 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 13 10:57:41.142472 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5ef8dd-df7a-43f4-bafc-94f3c8285668 None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:57:41.180188 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a95923-d136-433c-bc54-24065089a32d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:57:41.180831 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a95923-d136-433c-bc54-24065089a32d None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:41.181187 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a95923-d136-433c-bc54-24065089a32d None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:41.181493 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a95923-d136-433c-bc54-24065089a32d None admin] PATH_INFO: `/v3/users/969112bcc8bd40feafd70f73ef79b10d` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:41.182656 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a95923-d136-433c-bc54-24065089a32d None admin] RBAC: Authorizing `identity:get_user(user_id=969112bcc8bd40feafd70f73ef79b10d)` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:57:41.184152 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a95923-d136-433c-bc54-24065089a32d None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:57:41.188033 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 123/238] 10.222.0.18 () {56 vars in 1177 bytes} [Thu Oct 13 10:57:41 2022] GET /identity/v3/users/969112bcc8bd40feafd70f73ef79b10d => generated 293 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 13 10:57:41.191637 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f1882c-c8bc-4195-b026-de3ecb7f9594 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:57:41.304418 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f1882c-c8bc-4195-b026-de3ecb7f9594 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:57:41.312174 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:57:41.340682 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6930358f-0c32-4da3-b814-0f3e740acf91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:57:41.341282 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6930358f-0c32-4da3-b814-0f3e740acf91 None admin] REQUEST_METHOD: `PUT` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:41.341562 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6930358f-0c32-4da3-b814-0f3e740acf91 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:41.341836 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6930358f-0c32-4da3-b814-0f3e740acf91 None admin] PATH_INFO: `/v3/system/users/969112bcc8bd40feafd70f73ef79b10d/roles/a893cd4f751e445aab4dda1a832f24a1` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:41.343236 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6930358f-0c32-4da3-b814-0f3e740acf91 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=969112bcc8bd40feafd70f73ef79b10d, role_id=a893cd4f751e445aab4dda1a832f24a1)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:57:41.344600 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6930358f-0c32-4da3-b814-0f3e740acf91 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:57:41.354710 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 116/239] 10.222.0.18 () {58 vars in 1334 bytes} [Thu Oct 13 10:57:41 2022] PUT /identity/v3/system/users/969112bcc8bd40feafd70f73ef79b10d/roles/a893cd4f751e445aab4dda1a832f24a1 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 13 10:57:42.890383 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205401aa-4201-48c3-b4c9-54350a254e41 None None] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:42.890919 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205401aa-4201-48c3-b4c9-54350a254e41 None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:42.890919 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205401aa-4201-48c3-b4c9-54350a254e41 None None] PATH_INFO: `/` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:42.892291 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 124/240] 10.222.0.18 () {54 vars in 927 bytes} [Thu Oct 13 10:57:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 10:57:42.897362 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72235abf-2078-42a9-8498-1c0f84030ba1 None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:42.897741 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72235abf-2078-42a9-8498-1c0f84030ba1 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:42.897912 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72235abf-2078-42a9-8498-1c0f84030ba1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:42.917045 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-72235abf-2078-42a9-8498-1c0f84030ba1 None None] MFA Rules not processed for user `8ba31ade43694cf8bf28f7528a9ea179`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 10:57:42.918213 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-72235abf-2078-42a9-8498-1c0f84030ba1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 10:57:42.986200 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 117/241] 10.222.0.18 () {58 vars in 1024 bytes} [Thu Oct 13 10:57:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 13 10:57:43.216325 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e570db-ea1a-44e2-bb5d-0d520098ae88 None None] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:43.216627 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e570db-ea1a-44e2-bb5d-0d520098ae88 None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:43.216878 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e570db-ea1a-44e2-bb5d-0d520098ae88 None None] PATH_INFO: `/` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:43.218298 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 125/242] 10.222.0.18 () {54 vars in 927 bytes} [Thu Oct 13 10:57:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 10:57:43.223309 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767796da-469b-4cf0-84ef-e55ead3c7b64 None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:43.223595 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767796da-469b-4cf0-84ef-e55ead3c7b64 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:43.223867 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767796da-469b-4cf0-84ef-e55ead3c7b64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:43.242555 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-767796da-469b-4cf0-84ef-e55ead3c7b64 None None] MFA Rules not processed for user `8ba31ade43694cf8bf28f7528a9ea179`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 10:57:43.243857 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-767796da-469b-4cf0-84ef-e55ead3c7b64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 10:57:43.254942 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e570db-ea1a-44e2-bb5d-0d520098ae88 None None] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:57:43.291166 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:57:43.317980 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 118/243] 10.222.0.18 () {58 vars in 1024 bytes} [Thu Oct 13 10:57:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 13 10:57:43.359204 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e570db-ea1a-44e2-bb5d-0d520098ae88 None None] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:57:43.393565 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b5db96-0e5d-47fa-ba88-5d3b613162d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:57:43.394219 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b5db96-0e5d-47fa-ba88-5d3b613162d1 None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:43.394491 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b5db96-0e5d-47fa-ba88-5d3b613162d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:43.394756 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b5db96-0e5d-47fa-ba88-5d3b613162d1 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:43.395930 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b5db96-0e5d-47fa-ba88-5d3b613162d1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:57:43.397455 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b5db96-0e5d-47fa-ba88-5d3b613162d1 None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:57:43.399294 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 126/244] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Oct 13 10:57:43 2022] GET /identity/v3/domains/default => generated 199 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 13 10:57:43.405401 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767796da-469b-4cf0-84ef-e55ead3c7b64 None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:57:43.441071 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:57:43.512066 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767796da-469b-4cf0-84ef-e55ead3c7b64 None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:57:43.515994 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cbbbae-d56b-4db9-8034-fe5a08c96634 None None] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:43.516270 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cbbbae-d56b-4db9-8034-fe5a08c96634 None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:43.516531 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cbbbae-d56b-4db9-8034-fe5a08c96634 None None] PATH_INFO: `/` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:43.518035 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 127/245] 10.222.0.18 () {54 vars in 927 bytes} [Thu Oct 13 10:57:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 13 10:57:43.522722 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44695de-5cd5-4283-af22-bdaab7cdf934 None None] REQUEST_METHOD: `POST` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:43.522999 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44695de-5cd5-4283-af22-bdaab7cdf934 None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:43.523269 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44695de-5cd5-4283-af22-bdaab7cdf934 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:43.541596 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.auth.core [None req-a44695de-5cd5-4283-af22-bdaab7cdf934 None None] MFA Rules not processed for user `8ba31ade43694cf8bf28f7528a9ea179`. Rule list: `[]` (Enabled: `True`). {{(pid=81533) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 10:57:43.542762 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-a44695de-5cd5-4283-af22-bdaab7cdf934 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 10:57:43.547365 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66cf6dc2-a675-4418-8330-c62eca9fc762 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:57:43.547974 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cf6dc2-a675-4418-8330-c62eca9fc762 None admin] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:43.548252 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cf6dc2-a675-4418-8330-c62eca9fc762 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:43.548523 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cf6dc2-a675-4418-8330-c62eca9fc762 None admin] PATH_INFO: `/v3/groups` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:43.549180 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66cf6dc2-a675-4418-8330-c62eca9fc762 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:57:43.550609 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66cf6dc2-a675-4418-8330-c62eca9fc762 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:57:43.567027 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 119/246] 10.222.0.18 () {60 vars in 1134 bytes} [Thu Oct 13 10:57:43 2022] POST /identity/v3/groups => generated 226 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 13 10:57:43.587613 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66cf6dc2-a675-4418-8330-c62eca9fc762 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:57:43.621454 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 128/247] 10.222.0.18 () {58 vars in 1024 bytes} [Thu Oct 13 10:57:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 13 10:57:43.701530 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:57:43.714393 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66cf6dc2-a675-4418-8330-c62eca9fc762 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:57:43.757255 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88cd4c79-c243-444a-ad3e-e73715104be1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:57:43.757891 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cd4c79-c243-444a-ad3e-e73715104be1 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:43.758168 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cd4c79-c243-444a-ad3e-e73715104be1 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:43.758438 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cd4c79-c243-444a-ad3e-e73715104be1 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:43.768856 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88cd4c79-c243-444a-ad3e-e73715104be1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 13 10:57:43.774235 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application [None req-88cd4c79-c243-444a-ad3e-e73715104be1 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 13 10:57:43.774235 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 10:57:43.774235 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 10:57:43.774235 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 10:57:43.774235 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 10:57:43.774235 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 10:57:43.774235 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 10:57:43.774235 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 10:57:43.774235 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 10:57:43.774235 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 10:57:43.774235 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 10:57:43.774235 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 10:57:43.774235 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 13 10:57:43.774235 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 13 10:57:43.774235 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 13 10:57:43.774235 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 13 10:57:43.775498 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 13 10:57:43.775498 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 13 10:57:43.775498 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 13 10:57:43.775498 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 13 10:57:43.775498 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 10:57:43.775498 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 10:57:43.775498 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 10:57:43.775498 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 10:57:43.775498 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 10:57:43.775498 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 10:57:43.775498 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 10:57:43.775498 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application with Lock( Oct 13 10:57:43.775498 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 10:57:43.775498 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._enter() Oct 13 10:57:43.775498 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 10:57:43.775498 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 10:57:43.776321 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 10:57:43.776321 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.creator() Oct 13 10:57:43.776321 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 10:57:43.776321 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application created_value = creator( Oct 13 10:57:43.776321 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 13 10:57:43.776321 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 13 10:57:43.776321 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 13 10:57:43.776321 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 13 10:57:43.776321 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 13 10:57:43.776321 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 13 10:57:43.776321 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 13 10:57:43.776321 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application Oct 13 10:57:43.776321 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 120/248] 10.222.0.18 () {56 vars in 1099 bytes} [Thu Oct 13 10:57:43 2022] GET /identity/v3/roles/reader => generated 84 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 10:57:43.781256 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44695de-5cd5-4283-af22-bdaab7cdf934 None None] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:57:43.816321 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:57:43.891526 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44695de-5cd5-4283-af22-bdaab7cdf934 None None] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:57:43.900136 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88cd4c79-c243-444a-ad3e-e73715104be1 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:57:43.931991 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3611841d-567f-4d9d-9ff2-003ff2abe08f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:57:43.932761 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3611841d-567f-4d9d-9ff2-003ff2abe08f None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:43.933059 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3611841d-567f-4d9d-9ff2-003ff2abe08f None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:43.933394 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3611841d-567f-4d9d-9ff2-003ff2abe08f None admin] PATH_INFO: `/v3/roles` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:43.934188 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3611841d-567f-4d9d-9ff2-003ff2abe08f None admin] RBAC: Adding query filter params (name=reader) {{(pid=81533) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 10:57:43.934611 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3611841d-567f-4d9d-9ff2-003ff2abe08f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:57:43.935999 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3611841d-567f-4d9d-9ff2-003ff2abe08f None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:57:43.945776 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 129/249] 10.222.0.18 () {56 vars in 1101 bytes} [Thu Oct 13 10:57:43 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 10:57:43.951846 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3611841d-567f-4d9d-9ff2-003ff2abe08f None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:57:44.023640 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88cd4c79-c243-444a-ad3e-e73715104be1 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:57:44.065124 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780e2e66-08b3-46f9-a6d0-9addf1f588e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:57:44.065990 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:57:44.066575 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780e2e66-08b3-46f9-a6d0-9addf1f588e2 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:44.067466 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780e2e66-08b3-46f9-a6d0-9addf1f588e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:44.067921 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780e2e66-08b3-46f9-a6d0-9addf1f588e2 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:44.075459 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3611841d-567f-4d9d-9ff2-003ff2abe08f None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:57:44.083355 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780e2e66-08b3-46f9-a6d0-9addf1f588e2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 13 10:57:44.090326 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application [None req-780e2e66-08b3-46f9-a6d0-9addf1f588e2 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 13 10:57:44.090326 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 10:57:44.090326 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 10:57:44.090326 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 10:57:44.090326 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 10:57:44.090326 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 10:57:44.090326 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 10:57:44.090326 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 10:57:44.090326 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 10:57:44.090326 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 10:57:44.090326 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 10:57:44.090326 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 10:57:44.090326 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 13 10:57:44.090326 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 13 10:57:44.090326 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 13 10:57:44.090326 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 13 10:57:44.091268 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 13 10:57:44.091268 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 13 10:57:44.091268 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 13 10:57:44.091268 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 13 10:57:44.091268 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 10:57:44.091268 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 10:57:44.091268 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 10:57:44.091268 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 10:57:44.091268 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 10:57:44.091268 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 10:57:44.091268 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 10:57:44.091268 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application with Lock( Oct 13 10:57:44.091268 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 10:57:44.091268 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._enter() Oct 13 10:57:44.091268 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 10:57:44.091268 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 10:57:44.092077 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 10:57:44.092077 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.creator() Oct 13 10:57:44.092077 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 10:57:44.092077 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application created_value = creator( Oct 13 10:57:44.092077 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 13 10:57:44.092077 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 13 10:57:44.092077 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 13 10:57:44.092077 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 13 10:57:44.092077 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 13 10:57:44.092077 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 13 10:57:44.092077 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 13 10:57:44.092077 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application Oct 13 10:57:44.097503 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 121/250] 10.222.0.18 () {56 vars in 1099 bytes} [Thu Oct 13 10:57:43 2022] GET /identity/v3/roles/member => generated 84 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 10:57:44.103595 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780e2e66-08b3-46f9-a6d0-9addf1f588e2 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:57:44.116990 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:57:44.132488 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7219a33a-154b-4efb-81d5-eeae1395be63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:57:44.134702 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7219a33a-154b-4efb-81d5-eeae1395be63 None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:44.135190 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7219a33a-154b-4efb-81d5-eeae1395be63 None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:44.135630 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7219a33a-154b-4efb-81d5-eeae1395be63 None admin] PATH_INFO: `/v3/users/05fc2aa0266443cf9f993d9650aec909` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:44.137634 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7219a33a-154b-4efb-81d5-eeae1395be63 None admin] RBAC: Authorizing `identity:get_user(user_id=05fc2aa0266443cf9f993d9650aec909)` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:57:44.139797 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7219a33a-154b-4efb-81d5-eeae1395be63 None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:57:44.141656 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 130/251] 10.222.0.18 () {56 vars in 1177 bytes} [Thu Oct 13 10:57:43 2022] GET /identity/v3/users/05fc2aa0266443cf9f993d9650aec909 => generated 293 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 10:57:44.148285 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7219a33a-154b-4efb-81d5-eeae1395be63 None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:57:44.227453 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780e2e66-08b3-46f9-a6d0-9addf1f588e2 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:57:44.268581 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ac4e3e-f40c-4c7a-b748-1147b878ee1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:57:44.269462 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ac4e3e-f40c-4c7a-b748-1147b878ee1c None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:44.269571 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ac4e3e-f40c-4c7a-b748-1147b878ee1c None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:44.269756 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ac4e3e-f40c-4c7a-b748-1147b878ee1c None admin] PATH_INFO: `/v3/roles` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:44.270423 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ac4e3e-f40c-4c7a-b748-1147b878ee1c None admin] RBAC: Adding query filter params (name=member) {{(pid=81534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 10:57:44.270729 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ac4e3e-f40c-4c7a-b748-1147b878ee1c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:57:44.272109 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ac4e3e-f40c-4c7a-b748-1147b878ee1c None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:57:44.282545 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 122/252] 10.222.0.18 () {56 vars in 1101 bytes} [Thu Oct 13 10:57:44 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 13 10:57:44.288263 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ac4e3e-f40c-4c7a-b748-1147b878ee1c None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:57:44.293092 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7219a33a-154b-4efb-81d5-eeae1395be63 None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:57:44.339557 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d73f3a-bd90-42ec-b160-275f485a92ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:57:44.339947 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d73f3a-bd90-42ec-b160-275f485a92ce None admin] REQUEST_METHOD: `PUT` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:44.340227 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d73f3a-bd90-42ec-b160-275f485a92ce None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:44.340498 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d73f3a-bd90-42ec-b160-275f485a92ce None admin] PATH_INFO: `/v3/system/users/05fc2aa0266443cf9f993d9650aec909/roles/f0789756c6f1413090292bae8bd8df5a` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:44.341968 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d73f3a-bd90-42ec-b160-275f485a92ce None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=05fc2aa0266443cf9f993d9650aec909, role_id=f0789756c6f1413090292bae8bd8df5a)` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:57:44.343351 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d73f3a-bd90-42ec-b160-275f485a92ce None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:57:44.358195 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 131/253] 10.222.0.18 () {58 vars in 1334 bytes} [Thu Oct 13 10:57:44 2022] PUT /identity/v3/system/users/05fc2aa0266443cf9f993d9650aec909/roles/f0789756c6f1413090292bae8bd8df5a => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 10:57:44.397576 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:57:44.423906 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ac4e3e-f40c-4c7a-b748-1147b878ee1c None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:57:44.465553 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84ad01e-3c86-4ecc-9151-09a1692f1473 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:57:44.466198 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84ad01e-3c86-4ecc-9151-09a1692f1473 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:44.466475 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84ad01e-3c86-4ecc-9151-09a1692f1473 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:44.466747 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84ad01e-3c86-4ecc-9151-09a1692f1473 None admin] PATH_INFO: `/v3/users/969112bcc8bd40feafd70f73ef79b10d` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:44.467943 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84ad01e-3c86-4ecc-9151-09a1692f1473 None admin] RBAC: Authorizing `identity:get_user(user_id=969112bcc8bd40feafd70f73ef79b10d)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:57:44.469604 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84ad01e-3c86-4ecc-9151-09a1692f1473 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:57:44.471247 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 123/254] 10.222.0.18 () {56 vars in 1177 bytes} [Thu Oct 13 10:57:44 2022] GET /identity/v3/users/969112bcc8bd40feafd70f73ef79b10d => generated 293 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 10:57:44.477454 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d73f3a-bd90-42ec-b160-275f485a92ce None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:57:44.516229 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:57:44.621611 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d73f3a-bd90-42ec-b160-275f485a92ce None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:57:44.665683 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c789763-4d4d-4f72-88f0-7aaecd1a2b6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:57:44.666322 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c789763-4d4d-4f72-88f0-7aaecd1a2b6a None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:44.666599 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c789763-4d4d-4f72-88f0-7aaecd1a2b6a None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:44.666880 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c789763-4d4d-4f72-88f0-7aaecd1a2b6a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:44.667612 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c789763-4d4d-4f72-88f0-7aaecd1a2b6a None admin] RBAC: Adding query filter params (role.id=a893cd4f751e445aab4dda1a832f24a1, user.id=969112bcc8bd40feafd70f73ef79b10d, scope.system=all) {{(pid=81533) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 10:57:44.667918 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c789763-4d4d-4f72-88f0-7aaecd1a2b6a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:57:44.669401 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c789763-4d4d-4f72-88f0-7aaecd1a2b6a None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:57:44.682270 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 132/255] 10.222.0.18 () {56 vars in 1308 bytes} [Thu Oct 13 10:57:44 2022] GET /identity/v3/role_assignments?user.id=969112bcc8bd40feafd70f73ef79b10d&scope.system=all&role.id=a893cd4f751e445aab4dda1a832f24a1 => generated 510 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 10:57:46.087655 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d26dcb-fcc8-49ae-86ee-b102025e8581 None None] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:46.088159 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d26dcb-fcc8-49ae-86ee-b102025e8581 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:46.088159 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d26dcb-fcc8-49ae-86ee-b102025e8581 None None] PATH_INFO: `/` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:46.089643 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 124/256] 10.222.0.18 () {54 vars in 927 bytes} [Thu Oct 13 10:57:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 10:57:46.094947 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd51d936-7e57-4425-9ba3-f1de974ed72a None None] REQUEST_METHOD: `POST` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:46.095352 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd51d936-7e57-4425-9ba3-f1de974ed72a None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:46.095523 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd51d936-7e57-4425-9ba3-f1de974ed72a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:46.118034 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.auth.core [None req-fd51d936-7e57-4425-9ba3-f1de974ed72a None None] MFA Rules not processed for user `8ba31ade43694cf8bf28f7528a9ea179`. Rule list: `[]` (Enabled: `True`). {{(pid=81533) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 10:57:46.119436 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-fd51d936-7e57-4425-9ba3-f1de974ed72a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 10:57:46.190754 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 133/257] 10.222.0.18 () {58 vars in 1024 bytes} [Thu Oct 13 10:57:46 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Oct 13 10:57:46.483640 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d26dcb-fcc8-49ae-86ee-b102025e8581 None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:57:46.497621 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d26dcb-fcc8-49ae-86ee-b102025e8581 None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:57:46.503171 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855a3591-18d8-4e18-b632-429117a9d50e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ce4ee85562d450a9dc2f16f581130d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:57:46.503825 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855a3591-18d8-4e18-b632-429117a9d50e admin admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:46.504103 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855a3591-18d8-4e18-b632-429117a9d50e admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:46.504375 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855a3591-18d8-4e18-b632-429117a9d50e admin admin] PATH_INFO: `/v3/roles/member` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:46.517313 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855a3591-18d8-4e18-b632-429117a9d50e admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 13 10:57:46.522851 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application [None req-855a3591-18d8-4e18-b632-429117a9d50e admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 13 10:57:46.522851 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 10:57:46.522851 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 10:57:46.522851 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 10:57:46.522851 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 10:57:46.522851 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 10:57:46.522851 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 10:57:46.522851 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 10:57:46.522851 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 10:57:46.522851 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 10:57:46.522851 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 10:57:46.522851 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 10:57:46.522851 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 13 10:57:46.522851 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 13 10:57:46.522851 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 13 10:57:46.522851 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 13 10:57:46.523745 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 13 10:57:46.523745 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 13 10:57:46.523745 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 13 10:57:46.523745 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 13 10:57:46.523745 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 10:57:46.523745 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 10:57:46.523745 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 10:57:46.523745 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 10:57:46.523745 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 10:57:46.523745 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 10:57:46.523745 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 10:57:46.523745 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application with Lock( Oct 13 10:57:46.523745 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 10:57:46.523745 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._enter() Oct 13 10:57:46.523745 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 10:57:46.523745 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 10:57:46.525124 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 10:57:46.525124 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.creator() Oct 13 10:57:46.525124 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 10:57:46.525124 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application created_value = creator( Oct 13 10:57:46.525124 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 13 10:57:46.525124 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 13 10:57:46.525124 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 13 10:57:46.525124 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 13 10:57:46.525124 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 13 10:57:46.525124 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 13 10:57:46.525124 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 13 10:57:46.525124 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application Oct 13 10:57:46.526286 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 125/258] 10.222.0.18 () {56 vars in 1120 bytes} [Thu Oct 13 10:57:46 2022] GET /identity/v3/roles/member => generated 84 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 10:57:46.532958 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd51d936-7e57-4425-9ba3-f1de974ed72a None None] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:57:46.542421 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd51d936-7e57-4425-9ba3-f1de974ed72a None None] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:57:46.547042 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736e037e-c4f3-44a3-bb02-008d81cc62e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ce4ee85562d450a9dc2f16f581130d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:57:46.547655 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736e037e-c4f3-44a3-bb02-008d81cc62e7 admin admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:46.547930 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736e037e-c4f3-44a3-bb02-008d81cc62e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:46.548203 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736e037e-c4f3-44a3-bb02-008d81cc62e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:46.548947 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-736e037e-c4f3-44a3-bb02-008d81cc62e7 admin admin] RBAC: Adding query filter params (name=member) {{(pid=81533) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 10:57:46.549293 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-736e037e-c4f3-44a3-bb02-008d81cc62e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:57:46.551088 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: WARNING py.warnings [None req-736e037e-c4f3-44a3-bb02-008d81cc62e7 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 13 10:57:46.551088 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: warnings.warn(msg) Oct 13 10:57:46.551088 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: Oct 13 10:57:46.552193 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-736e037e-c4f3-44a3-bb02-008d81cc62e7 admin admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:57:46.566457 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 134/259] 10.222.0.18 () {56 vars in 1122 bytes} [Thu Oct 13 10:57:46 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 10:57:46.567806 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855a3591-18d8-4e18-b632-429117a9d50e admin admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:57:46.580083 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855a3591-18d8-4e18-b632-429117a9d50e admin admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:57:46.584760 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9d0ce9-8c2f-40bc-9b39-63ab3e73b401 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ce4ee85562d450a9dc2f16f581130d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:57:46.585419 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9d0ce9-8c2f-40bc-9b39-63ab3e73b401 admin admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:46.585700 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9d0ce9-8c2f-40bc-9b39-63ab3e73b401 admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:46.586074 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9d0ce9-8c2f-40bc-9b39-63ab3e73b401 admin admin] PATH_INFO: `/v3/groups/c0f6480dd0644b418eedd8e7fc1bff03` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:46.594917 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff9d0ce9-8c2f-40bc-9b39-63ab3e73b401 admin admin] RBAC: Authorizing `identity:get_group(group_id=c0f6480dd0644b418eedd8e7fc1bff03)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:57:46.596757 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: WARNING py.warnings [None req-ff9d0ce9-8c2f-40bc-9b39-63ab3e73b401 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_group": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 13 10:57:46.596757 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: warnings.warn(msg) Oct 13 10:57:46.596757 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: Oct 13 10:57:46.598037 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff9d0ce9-8c2f-40bc-9b39-63ab3e73b401 admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:57:46.599742 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 126/260] 10.222.0.18 () {56 vars in 1201 bytes} [Thu Oct 13 10:57:46 2022] GET /identity/v3/groups/c0f6480dd0644b418eedd8e7fc1bff03 => generated 226 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 13 10:57:46.605521 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736e037e-c4f3-44a3-bb02-008d81cc62e7 admin admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:57:46.616511 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736e037e-c4f3-44a3-bb02-008d81cc62e7 admin admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:57:46.621645 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c72b6c-c785-406c-997c-66eb583c7b7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ce4ee85562d450a9dc2f16f581130d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:57:46.622317 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c72b6c-c785-406c-997c-66eb583c7b7a admin admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:46.622604 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c72b6c-c785-406c-997c-66eb583c7b7a admin admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:46.622877 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c72b6c-c785-406c-997c-66eb583c7b7a admin admin] PATH_INFO: `/v3/projects/8b052a27256842f098af78fca7334623` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:46.624007 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c72b6c-c785-406c-997c-66eb583c7b7a admin admin] RBAC: Authorizing `identity:get_project(project_id=8b052a27256842f098af78fca7334623)` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:57:46.626151 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c72b6c-c785-406c-997c-66eb583c7b7a admin admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:57:46.632765 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 135/261] 10.222.0.18 () {56 vars in 1207 bytes} [Thu Oct 13 10:57:46 2022] GET /identity/v3/projects/8b052a27256842f098af78fca7334623 => generated 298 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 10:57:46.634206 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9d0ce9-8c2f-40bc-9b39-63ab3e73b401 admin admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:57:46.645084 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9d0ce9-8c2f-40bc-9b39-63ab3e73b401 admin admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:57:46.650192 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e94ec93-6b0c-43ab-8502-d33a026b8250 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ce4ee85562d450a9dc2f16f581130d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:57:46.650875 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e94ec93-6b0c-43ab-8502-d33a026b8250 admin admin] REQUEST_METHOD: `PUT` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:46.651377 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e94ec93-6b0c-43ab-8502-d33a026b8250 admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:46.651659 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e94ec93-6b0c-43ab-8502-d33a026b8250 admin admin] PATH_INFO: `/v3/projects/8b052a27256842f098af78fca7334623/groups/c0f6480dd0644b418eedd8e7fc1bff03/roles/a893cd4f751e445aab4dda1a832f24a1` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:46.653665 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e94ec93-6b0c-43ab-8502-d33a026b8250 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8b052a27256842f098af78fca7334623, group_id=c0f6480dd0644b418eedd8e7fc1bff03, role_id=a893cd4f751e445aab4dda1a832f24a1)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:57:46.654746 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: WARNING py.warnings [None req-6e94ec93-6b0c-43ab-8502-d33a026b8250 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 13 10:57:46.654746 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: warnings.warn(msg) Oct 13 10:57:46.654746 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: Oct 13 10:57:46.656912 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e94ec93-6b0c-43ab-8502-d33a026b8250 admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:57:46.679222 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 127/262] 10.222.0.18 () {58 vars in 1463 bytes} [Thu Oct 13 10:57:46 2022] PUT /identity/v3/projects/8b052a27256842f098af78fca7334623/groups/c0f6480dd0644b418eedd8e7fc1bff03/roles/a893cd4f751e445aab4dda1a832f24a1 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 10:57:47.145639 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b278b5d4-64ce-4dba-8ca6-665efea8160a None None] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:47.146373 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b278b5d4-64ce-4dba-8ca6-665efea8160a None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:47.146373 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b278b5d4-64ce-4dba-8ca6-665efea8160a None None] PATH_INFO: `/` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:47.147743 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 136/263] 10.222.0.18 () {54 vars in 927 bytes} [Thu Oct 13 10:57:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 10:57:47.153763 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a30b706-0771-472a-bec4-82c5f3d84205 None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:47.154333 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a30b706-0771-472a-bec4-82c5f3d84205 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:47.154333 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a30b706-0771-472a-bec4-82c5f3d84205 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:47.182033 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-6a30b706-0771-472a-bec4-82c5f3d84205 None None] MFA Rules not processed for user `8ba31ade43694cf8bf28f7528a9ea179`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 10:57:47.183267 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-6a30b706-0771-472a-bec4-82c5f3d84205 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 10:57:47.263559 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9a8a3a-26d4-4dfe-a9e4-905118d5d3bf None None] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:47.263871 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9a8a3a-26d4-4dfe-a9e4-905118d5d3bf None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:47.264093 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9a8a3a-26d4-4dfe-a9e4-905118d5d3bf None None] PATH_INFO: `/` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:47.265746 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 137/264] 10.222.0.18 () {54 vars in 927 bytes} [Thu Oct 13 10:57:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 10:57:47.268474 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 128/265] 10.222.0.18 () {58 vars in 1024 bytes} [Thu Oct 13 10:57:47 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Oct 13 10:57:47.273555 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f93a5b-5530-469d-95e4-69413345f5bc None None] REQUEST_METHOD: `POST` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:47.273830 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f93a5b-5530-469d-95e4-69413345f5bc None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:47.274100 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f93a5b-5530-469d-95e4-69413345f5bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:47.310163 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.auth.core [None req-94f93a5b-5530-469d-95e4-69413345f5bc None None] MFA Rules not processed for user `8ba31ade43694cf8bf28f7528a9ea179`. Rule list: `[]` (Enabled: `True`). {{(pid=81533) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 10:57:47.311390 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-94f93a5b-5530-469d-95e4-69413345f5bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 10:57:47.319141 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 138/266] 10.222.0.18 () {58 vars in 1024 bytes} [Thu Oct 13 10:57:47 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Oct 13 10:57:47.448684 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cff2012-a383-4f0c-9332-c06af1ade517 None None] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:47.449072 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cff2012-a383-4f0c-9332-c06af1ade517 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:47.449298 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cff2012-a383-4f0c-9332-c06af1ade517 None None] PATH_INFO: `/` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:47.450752 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 129/267] 10.222.0.18 () {54 vars in 927 bytes} [Thu Oct 13 10:57:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 10:57:47.456127 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c32425-4f07-44ca-a54a-bc125051ee74 None None] REQUEST_METHOD: `POST` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:47.456621 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c32425-4f07-44ca-a54a-bc125051ee74 None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:47.457118 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c32425-4f07-44ca-a54a-bc125051ee74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:47.479120 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.auth.core [None req-74c32425-4f07-44ca-a54a-bc125051ee74 None None] MFA Rules not processed for user `8ba31ade43694cf8bf28f7528a9ea179`. Rule list: `[]` (Enabled: `True`). {{(pid=81533) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 10:57:47.480605 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-74c32425-4f07-44ca-a54a-bc125051ee74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 10:57:47.483797 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:57:47.562324 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 139/268] 10.222.0.18 () {58 vars in 1024 bytes} [Thu Oct 13 10:57:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 13 10:57:47.807514 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cff2012-a383-4f0c-9332-c06af1ade517 None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:57:47.824220 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cff2012-a383-4f0c-9332-c06af1ade517 None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:57:47.833044 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81620e72-31af-43bb-9424-57845d53c30a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ce4ee85562d450a9dc2f16f581130d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:57:47.833680 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81620e72-31af-43bb-9424-57845d53c30a admin admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:47.833960 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81620e72-31af-43bb-9424-57845d53c30a admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:47.834232 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81620e72-31af-43bb-9424-57845d53c30a admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:47.846520 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81620e72-31af-43bb-9424-57845d53c30a admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 13 10:57:47.851606 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application [None req-81620e72-31af-43bb-9424-57845d53c30a admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 13 10:57:47.851606 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 10:57:47.851606 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 10:57:47.851606 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 10:57:47.851606 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 10:57:47.851606 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 10:57:47.851606 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 10:57:47.851606 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 10:57:47.851606 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 10:57:47.851606 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 10:57:47.851606 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 10:57:47.851606 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 10:57:47.851606 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 13 10:57:47.851606 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 13 10:57:47.851606 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 13 10:57:47.851606 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 13 10:57:47.852581 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 13 10:57:47.852581 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 13 10:57:47.852581 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 13 10:57:47.852581 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 13 10:57:47.852581 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 10:57:47.852581 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 10:57:47.852581 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 10:57:47.852581 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 10:57:47.852581 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 10:57:47.852581 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 10:57:47.852581 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 10:57:47.852581 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application with Lock( Oct 13 10:57:47.852581 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 10:57:47.852581 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._enter() Oct 13 10:57:47.852581 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 10:57:47.852581 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 10:57:47.853760 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 10:57:47.853760 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.creator() Oct 13 10:57:47.853760 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 10:57:47.853760 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application created_value = creator( Oct 13 10:57:47.853760 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 13 10:57:47.853760 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 13 10:57:47.853760 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 13 10:57:47.853760 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 13 10:57:47.853760 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 13 10:57:47.853760 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 13 10:57:47.853760 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 13 10:57:47.853760 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application Oct 13 10:57:47.857037 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 130/269] 10.222.0.18 () {56 vars in 1135 bytes} [Thu Oct 13 10:57:47 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 13 10:57:47.859444 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c32425-4f07-44ca-a54a-bc125051ee74 None None] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:57:47.874453 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c32425-4f07-44ca-a54a-bc125051ee74 None None] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:57:47.882623 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74ceb97-e3b5-4751-b5fd-75078f88626b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ce4ee85562d450a9dc2f16f581130d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:57:47.883241 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74ceb97-e3b5-4751-b5fd-75078f88626b admin admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:47.883520 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74ceb97-e3b5-4751-b5fd-75078f88626b admin admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:47.883904 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74ceb97-e3b5-4751-b5fd-75078f88626b admin admin] PATH_INFO: `/v3/roles` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:47.884674 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74ceb97-e3b5-4751-b5fd-75078f88626b admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81533) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 10:57:47.884983 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74ceb97-e3b5-4751-b5fd-75078f88626b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:57:47.886645 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74ceb97-e3b5-4751-b5fd-75078f88626b admin admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:57:47.897127 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 140/270] 10.222.0.18 () {56 vars in 1132 bytes} [Thu Oct 13 10:57:47 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 10:57:47.901805 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81620e72-31af-43bb-9424-57845d53c30a admin admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:57:47.903412 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74ceb97-e3b5-4751-b5fd-75078f88626b admin admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:57:47.914849 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81620e72-31af-43bb-9424-57845d53c30a admin admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:57:47.915343 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74ceb97-e3b5-4751-b5fd-75078f88626b admin admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:57:47.922056 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528d162a-f9b2-491a-b91d-8f3765fded90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ce4ee85562d450a9dc2f16f581130d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:57:47.922738 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528d162a-f9b2-491a-b91d-8f3765fded90 admin admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:47.923023 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528d162a-f9b2-491a-b91d-8f3765fded90 admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:47.923298 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528d162a-f9b2-491a-b91d-8f3765fded90 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:47.923531 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e17549-a87d-4da5-b058-d65f17fff450 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ce4ee85562d450a9dc2f16f581130d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:57:47.924354 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e17549-a87d-4da5-b058-d65f17fff450 admin admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:47.924877 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e17549-a87d-4da5-b058-d65f17fff450 admin admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:47.925358 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e17549-a87d-4da5-b058-d65f17fff450 admin admin] PATH_INFO: `/v3/groups/c0f6480dd0644b418eedd8e7fc1bff03` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:47.926652 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e17549-a87d-4da5-b058-d65f17fff450 admin admin] RBAC: Authorizing `identity:get_group(group_id=c0f6480dd0644b418eedd8e7fc1bff03)` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:57:47.927899 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: WARNING py.warnings [None req-99e17549-a87d-4da5-b058-d65f17fff450 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_group": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 13 10:57:47.927899 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: warnings.warn(msg) Oct 13 10:57:47.927899 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: Oct 13 10:57:47.929529 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e17549-a87d-4da5-b058-d65f17fff450 admin admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:57:47.932294 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 141/271] 10.222.0.18 () {56 vars in 1201 bytes} [Thu Oct 13 10:57:47 2022] GET /identity/v3/groups/c0f6480dd0644b418eedd8e7fc1bff03 => generated 226 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 13 10:57:47.941918 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528d162a-f9b2-491a-b91d-8f3765fded90 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 13 10:57:47.947174 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application [None req-528d162a-f9b2-491a-b91d-8f3765fded90 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 13 10:57:47.947174 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 10:57:47.947174 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 10:57:47.947174 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 10:57:47.947174 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 10:57:47.947174 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 10:57:47.947174 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 10:57:47.947174 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 10:57:47.947174 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 10:57:47.947174 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 10:57:47.947174 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 10:57:47.947174 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 10:57:47.947174 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 13 10:57:47.947174 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 13 10:57:47.947174 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 13 10:57:47.947174 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 13 10:57:47.948104 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 13 10:57:47.948104 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 13 10:57:47.948104 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 13 10:57:47.948104 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 13 10:57:47.948104 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 10:57:47.948104 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 10:57:47.948104 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 10:57:47.948104 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 10:57:47.948104 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 10:57:47.948104 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 10:57:47.948104 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 10:57:47.948104 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application with Lock( Oct 13 10:57:47.948104 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 10:57:47.948104 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._enter() Oct 13 10:57:47.948104 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 10:57:47.948104 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 10:57:47.948902 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 10:57:47.948902 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.creator() Oct 13 10:57:47.948902 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 10:57:47.948902 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application created_value = creator( Oct 13 10:57:47.948902 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 13 10:57:47.948902 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 13 10:57:47.948902 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 13 10:57:47.948902 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 13 10:57:47.948902 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 13 10:57:47.948902 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 13 10:57:47.948902 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 13 10:57:47.948902 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application Oct 13 10:57:47.948902 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 131/272] 10.222.0.18 () {56 vars in 1120 bytes} [Thu Oct 13 10:57:47 2022] GET /identity/v3/roles/member => generated 84 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 10:57:47.951263 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e17549-a87d-4da5-b058-d65f17fff450 admin admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:57:47.958295 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528d162a-f9b2-491a-b91d-8f3765fded90 admin admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:57:47.962786 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e17549-a87d-4da5-b058-d65f17fff450 admin admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:57:47.967560 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a5dbfd-e850-4e7f-8d63-ffb15b302f1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ce4ee85562d450a9dc2f16f581130d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:57:47.968441 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a5dbfd-e850-4e7f-8d63-ffb15b302f1f admin admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:47.968926 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a5dbfd-e850-4e7f-8d63-ffb15b302f1f admin admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:47.969440 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a5dbfd-e850-4e7f-8d63-ffb15b302f1f admin admin] PATH_INFO: `/v3/projects/8b052a27256842f098af78fca7334623` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:47.969763 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528d162a-f9b2-491a-b91d-8f3765fded90 admin admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:57:47.971070 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a5dbfd-e850-4e7f-8d63-ffb15b302f1f admin admin] RBAC: Authorizing `identity:get_project(project_id=8b052a27256842f098af78fca7334623)` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:57:47.975729 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a5dbfd-e850-4e7f-8d63-ffb15b302f1f admin admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:57:47.978249 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 142/273] 10.222.0.18 () {56 vars in 1207 bytes} [Thu Oct 13 10:57:47 2022] GET /identity/v3/projects/8b052a27256842f098af78fca7334623 => generated 298 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 10:57:47.982175 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63be0ba-e129-48b3-9bc1-8a1f435e0cbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ce4ee85562d450a9dc2f16f581130d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:57:47.982743 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63be0ba-e129-48b3-9bc1-8a1f435e0cbe admin admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:47.983024 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63be0ba-e129-48b3-9bc1-8a1f435e0cbe admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:47.983301 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63be0ba-e129-48b3-9bc1-8a1f435e0cbe admin admin] PATH_INFO: `/v3/roles` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:47.983983 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d63be0ba-e129-48b3-9bc1-8a1f435e0cbe admin admin] RBAC: Adding query filter params (name=member) {{(pid=81534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 10:57:47.984292 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d63be0ba-e129-48b3-9bc1-8a1f435e0cbe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:57:47.989070 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: WARNING py.warnings [None req-d63be0ba-e129-48b3-9bc1-8a1f435e0cbe admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 13 10:57:47.989070 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: warnings.warn(msg) Oct 13 10:57:47.989070 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: Oct 13 10:57:47.989070 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d63be0ba-e129-48b3-9bc1-8a1f435e0cbe admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:57:48.000789 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 132/274] 10.222.0.18 () {56 vars in 1122 bytes} [Thu Oct 13 10:57:47 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 10:57:48.002197 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a5dbfd-e850-4e7f-8d63-ffb15b302f1f admin admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:57:48.006330 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63be0ba-e129-48b3-9bc1-8a1f435e0cbe admin admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:57:48.017599 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a5dbfd-e850-4e7f-8d63-ffb15b302f1f admin admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:57:48.024120 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63be0ba-e129-48b3-9bc1-8a1f435e0cbe admin admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:57:48.029900 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-addc600f-c636-4c67-8008-ad6b6204bdc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ce4ee85562d450a9dc2f16f581130d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:57:48.031815 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addc600f-c636-4c67-8008-ad6b6204bdc5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:48.032654 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addc600f-c636-4c67-8008-ad6b6204bdc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:48.033326 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addc600f-c636-4c67-8008-ad6b6204bdc5 admin admin] PATH_INFO: `/v3/projects/8b052a27256842f098af78fca7334623/groups/c0f6480dd0644b418eedd8e7fc1bff03/roles/e49be8727cbd4a39b3fbe6925f5af415` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:48.035470 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34697328-8dd3-4d87-9fb3-934c16e04805 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ce4ee85562d450a9dc2f16f581130d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:57:48.037418 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34697328-8dd3-4d87-9fb3-934c16e04805 admin admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:48.038265 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-addc600f-c636-4c67-8008-ad6b6204bdc5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8b052a27256842f098af78fca7334623, group_id=c0f6480dd0644b418eedd8e7fc1bff03, role_id=e49be8727cbd4a39b3fbe6925f5af415)` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:57:48.038827 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34697328-8dd3-4d87-9fb3-934c16e04805 admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:48.039354 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34697328-8dd3-4d87-9fb3-934c16e04805 admin admin] PATH_INFO: `/v3/groups/c0f6480dd0644b418eedd8e7fc1bff03` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:48.041520 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: WARNING py.warnings [None req-addc600f-c636-4c67-8008-ad6b6204bdc5 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 13 10:57:48.041520 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: warnings.warn(msg) Oct 13 10:57:48.041520 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: Oct 13 10:57:48.042442 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34697328-8dd3-4d87-9fb3-934c16e04805 admin admin] RBAC: Authorizing `identity:get_group(group_id=c0f6480dd0644b418eedd8e7fc1bff03)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:57:48.045790 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-addc600f-c636-4c67-8008-ad6b6204bdc5 admin admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:57:48.046941 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34697328-8dd3-4d87-9fb3-934c16e04805 admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:57:48.050775 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 133/275] 10.222.0.18 () {56 vars in 1201 bytes} [Thu Oct 13 10:57:48 2022] GET /identity/v3/groups/c0f6480dd0644b418eedd8e7fc1bff03 => generated 226 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 13 10:57:48.056824 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34697328-8dd3-4d87-9fb3-934c16e04805 admin admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:57:48.070721 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 143/276] 10.222.0.18 () {58 vars in 1463 bytes} [Thu Oct 13 10:57:48 2022] PUT /identity/v3/projects/8b052a27256842f098af78fca7334623/groups/c0f6480dd0644b418eedd8e7fc1bff03/roles/e49be8727cbd4a39b3fbe6925f5af415 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 10:57:48.074001 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34697328-8dd3-4d87-9fb3-934c16e04805 admin admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:57:48.103542 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:57:48.136027 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-addc600f-c636-4c67-8008-ad6b6204bdc5 admin admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:57:48.162920 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4357c1-2dae-4f1a-9046-682cdb026514 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ce4ee85562d450a9dc2f16f581130d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:57:48.163788 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4357c1-2dae-4f1a-9046-682cdb026514 admin admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:48.164062 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4357c1-2dae-4f1a-9046-682cdb026514 admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:48.164331 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4357c1-2dae-4f1a-9046-682cdb026514 admin admin] PATH_INFO: `/v3/projects/ab0fe3e4091a40ca831652b16957b46a` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:48.167094 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e4357c1-2dae-4f1a-9046-682cdb026514 admin admin] RBAC: Authorizing `identity:get_project(project_id=ab0fe3e4091a40ca831652b16957b46a)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:57:48.175194 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e4357c1-2dae-4f1a-9046-682cdb026514 admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:57:48.182131 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 134/277] 10.222.0.18 () {56 vars in 1207 bytes} [Thu Oct 13 10:57:48 2022] GET /identity/v3/projects/ab0fe3e4091a40ca831652b16957b46a => generated 302 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 10:57:48.185407 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4357c1-2dae-4f1a-9046-682cdb026514 admin admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:57:48.207873 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4357c1-2dae-4f1a-9046-682cdb026514 admin admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:57:48.221327 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cadc419-3593-4385-a237-53be7a53b9b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ce4ee85562d450a9dc2f16f581130d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:57:48.222111 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cadc419-3593-4385-a237-53be7a53b9b5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:48.222387 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cadc419-3593-4385-a237-53be7a53b9b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:48.222659 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cadc419-3593-4385-a237-53be7a53b9b5 admin admin] PATH_INFO: `/v3/projects/ab0fe3e4091a40ca831652b16957b46a/groups/c0f6480dd0644b418eedd8e7fc1bff03/roles/a893cd4f751e445aab4dda1a832f24a1` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:48.224848 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cadc419-3593-4385-a237-53be7a53b9b5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ab0fe3e4091a40ca831652b16957b46a, group_id=c0f6480dd0644b418eedd8e7fc1bff03, role_id=a893cd4f751e445aab4dda1a832f24a1)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:57:48.228220 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cadc419-3593-4385-a237-53be7a53b9b5 admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:57:48.254020 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 135/278] 10.222.0.18 () {58 vars in 1463 bytes} [Thu Oct 13 10:57:48 2022] PUT /identity/v3/projects/ab0fe3e4091a40ca831652b16957b46a/groups/c0f6480dd0644b418eedd8e7fc1bff03/roles/a893cd4f751e445aab4dda1a832f24a1 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 10:57:48.348633 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-addc600f-c636-4c67-8008-ad6b6204bdc5 admin admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:57:48.369369 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:57:48.401863 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e74cbe-e88d-4e70-ab4f-74ec16ac52e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:57:48.402530 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e74cbe-e88d-4e70-ab4f-74ec16ac52e2 None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:48.402810 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e74cbe-e88d-4e70-ab4f-74ec16ac52e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:48.403083 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e74cbe-e88d-4e70-ab4f-74ec16ac52e2 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:48.420133 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e74cbe-e88d-4e70-ab4f-74ec16ac52e2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 13 10:57:48.425628 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application [None req-30e74cbe-e88d-4e70-ab4f-74ec16ac52e2 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 13 10:57:48.425628 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 10:57:48.425628 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 10:57:48.425628 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 10:57:48.425628 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 10:57:48.425628 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 10:57:48.425628 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 10:57:48.425628 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 10:57:48.425628 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 10:57:48.425628 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 10:57:48.425628 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 10:57:48.425628 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 10:57:48.425628 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 13 10:57:48.425628 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 13 10:57:48.425628 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 13 10:57:48.425628 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 13 10:57:48.426602 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 13 10:57:48.426602 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 13 10:57:48.426602 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 13 10:57:48.426602 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 13 10:57:48.426602 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 10:57:48.426602 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 10:57:48.426602 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 10:57:48.426602 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 10:57:48.426602 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 10:57:48.426602 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 10:57:48.426602 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 10:57:48.426602 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application with Lock( Oct 13 10:57:48.426602 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 10:57:48.426602 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._enter() Oct 13 10:57:48.426602 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 10:57:48.426602 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 10:57:48.428014 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 10:57:48.428014 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.creator() Oct 13 10:57:48.428014 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 10:57:48.428014 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application created_value = creator( Oct 13 10:57:48.428014 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 13 10:57:48.428014 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 13 10:57:48.428014 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 13 10:57:48.428014 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 13 10:57:48.428014 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 13 10:57:48.428014 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 13 10:57:48.428014 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 13 10:57:48.428014 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application Oct 13 10:57:48.428014 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 144/279] 10.222.0.18 () {56 vars in 1099 bytes} [Thu Oct 13 10:57:48 2022] GET /identity/v3/roles/reader => generated 84 bytes in 291 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 10:57:48.434057 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cadc419-3593-4385-a237-53be7a53b9b5 admin admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:57:48.578905 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cadc419-3593-4385-a237-53be7a53b9b5 admin admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:57:48.619731 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55974b4c-2525-4e1f-ac1a-cabf58991bf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:57:48.620386 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55974b4c-2525-4e1f-ac1a-cabf58991bf7 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:48.620665 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55974b4c-2525-4e1f-ac1a-cabf58991bf7 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:48.620929 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55974b4c-2525-4e1f-ac1a-cabf58991bf7 None admin] PATH_INFO: `/v3/roles` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:48.621694 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55974b4c-2525-4e1f-ac1a-cabf58991bf7 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 10:57:48.621996 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55974b4c-2525-4e1f-ac1a-cabf58991bf7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:57:48.623385 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55974b4c-2525-4e1f-ac1a-cabf58991bf7 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:57:48.635021 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 136/280] 10.222.0.18 () {56 vars in 1101 bytes} [Thu Oct 13 10:57:48 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 10:57:48.640866 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e74cbe-e88d-4e70-ab4f-74ec16ac52e2 None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:57:48.656752 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67319a20-452c-432c-8bab-4a5ac6aa7230 None None] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:48.657076 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67319a20-452c-432c-8bab-4a5ac6aa7230 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:48.657327 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67319a20-452c-432c-8bab-4a5ac6aa7230 None None] PATH_INFO: `/` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:48.658898 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 137/281] 10.222.0.18 () {54 vars in 927 bytes} [Thu Oct 13 10:57:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 10:57:48.664810 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd8f4b6-995a-48c1-bc41-fa1e9d02241b None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:48.665238 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd8f4b6-995a-48c1-bc41-fa1e9d02241b None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:48.665504 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd8f4b6-995a-48c1-bc41-fa1e9d02241b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:48.688177 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-2bd8f4b6-995a-48c1-bc41-fa1e9d02241b None None] MFA Rules not processed for user `8ba31ade43694cf8bf28f7528a9ea179`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 10:57:48.689433 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-2bd8f4b6-995a-48c1-bc41-fa1e9d02241b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 10:57:48.700320 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:57:48.767471 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 138/282] 10.222.0.18 () {58 vars in 1024 bytes} [Thu Oct 13 10:57:48 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Oct 13 10:57:48.836437 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e74cbe-e88d-4e70-ab4f-74ec16ac52e2 None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:57:48.875846 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e7d3cc-a434-4505-aaa1-087648833c36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:57:48.876479 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e7d3cc-a434-4505-aaa1-087648833c36 None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:48.876755 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e7d3cc-a434-4505-aaa1-087648833c36 None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:48.877042 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e7d3cc-a434-4505-aaa1-087648833c36 None admin] PATH_INFO: `/v3/users/05fc2aa0266443cf9f993d9650aec909` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:48.882018 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e7d3cc-a434-4505-aaa1-087648833c36 None admin] RBAC: Authorizing `identity:get_user(user_id=05fc2aa0266443cf9f993d9650aec909)` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:57:48.883485 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e7d3cc-a434-4505-aaa1-087648833c36 None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:57:48.885277 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 145/283] 10.222.0.18 () {56 vars in 1177 bytes} [Thu Oct 13 10:57:48 2022] GET /identity/v3/users/05fc2aa0266443cf9f993d9650aec909 => generated 293 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 10:57:48.891278 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd8f4b6-995a-48c1-bc41-fa1e9d02241b None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:57:49.037323 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd8f4b6-995a-48c1-bc41-fa1e9d02241b None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:57:49.088750 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11188b5-705a-4ece-b20c-d617f3cc2b7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:57:49.089328 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11188b5-705a-4ece-b20c-d617f3cc2b7b None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:49.089606 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11188b5-705a-4ece-b20c-d617f3cc2b7b None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:49.089879 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11188b5-705a-4ece-b20c-d617f3cc2b7b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:49.090618 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11188b5-705a-4ece-b20c-d617f3cc2b7b None admin] RBAC: Adding query filter params (role.id=f0789756c6f1413090292bae8bd8df5a, user.id=05fc2aa0266443cf9f993d9650aec909, scope.system=all) {{(pid=81534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 10:57:49.091032 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11188b5-705a-4ece-b20c-d617f3cc2b7b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:57:49.092388 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11188b5-705a-4ece-b20c-d617f3cc2b7b None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:57:49.105777 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 139/284] 10.222.0.18 () {56 vars in 1308 bytes} [Thu Oct 13 10:57:48 2022] GET /identity/v3/role_assignments?user.id=05fc2aa0266443cf9f993d9650aec909&scope.system=all&role.id=f0789756c6f1413090292bae8bd8df5a => generated 510 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 10:57:49.110849 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06759f66-cfc3-4ae7-b2d1-8ad77c07fc13 None None] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:49.111130 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06759f66-cfc3-4ae7-b2d1-8ad77c07fc13 None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:49.111396 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06759f66-cfc3-4ae7-b2d1-8ad77c07fc13 None None] PATH_INFO: `/` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:49.112865 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 146/285] 10.222.0.18 () {54 vars in 927 bytes} [Thu Oct 13 10:57:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 10:57:49.119402 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade65f34-0320-4a66-b559-06bce62451ec None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:49.119709 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade65f34-0320-4a66-b559-06bce62451ec None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:49.119965 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade65f34-0320-4a66-b559-06bce62451ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:49.142307 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-ade65f34-0320-4a66-b559-06bce62451ec None None] MFA Rules not processed for user `8ba31ade43694cf8bf28f7528a9ea179`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 10:57:49.143537 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-ade65f34-0320-4a66-b559-06bce62451ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 10:57:49.151885 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 140/286] 10.222.0.18 () {58 vars in 1024 bytes} [Thu Oct 13 10:57:49 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Oct 13 10:57:49.164104 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06759f66-cfc3-4ae7-b2d1-8ad77c07fc13 None None] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:57:49.189854 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06759f66-cfc3-4ae7-b2d1-8ad77c07fc13 None None] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:57:49.194470 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10e7925-af91-49d2-bd8e-fbc0f58fffdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ce4ee85562d450a9dc2f16f581130d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:57:49.195108 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10e7925-af91-49d2-bd8e-fbc0f58fffdf admin admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:49.195386 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10e7925-af91-49d2-bd8e-fbc0f58fffdf admin admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:49.195657 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10e7925-af91-49d2-bd8e-fbc0f58fffdf admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:49.217994 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10e7925-af91-49d2-bd8e-fbc0f58fffdf admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 13 10:57:49.222894 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application [None req-d10e7925-af91-49d2-bd8e-fbc0f58fffdf admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 13 10:57:49.222894 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 10:57:49.222894 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 10:57:49.222894 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 10:57:49.222894 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 10:57:49.222894 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 10:57:49.222894 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 10:57:49.222894 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 10:57:49.222894 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 10:57:49.222894 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 10:57:49.222894 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 10:57:49.222894 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 10:57:49.222894 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 13 10:57:49.222894 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 13 10:57:49.222894 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 13 10:57:49.222894 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 13 10:57:49.223774 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 13 10:57:49.223774 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 13 10:57:49.223774 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 13 10:57:49.223774 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 13 10:57:49.223774 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 10:57:49.223774 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 10:57:49.223774 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 10:57:49.223774 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 10:57:49.223774 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 10:57:49.223774 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 10:57:49.223774 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 10:57:49.223774 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application with Lock( Oct 13 10:57:49.223774 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 10:57:49.223774 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._enter() Oct 13 10:57:49.223774 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 10:57:49.223774 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 10:57:49.224603 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 10:57:49.224603 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.creator() Oct 13 10:57:49.224603 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 10:57:49.224603 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application created_value = creator( Oct 13 10:57:49.224603 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 13 10:57:49.224603 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 13 10:57:49.224603 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 13 10:57:49.224603 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 13 10:57:49.224603 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 13 10:57:49.224603 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 13 10:57:49.224603 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 13 10:57:49.224603 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application Oct 13 10:57:49.224603 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 147/287] 10.222.0.18 () {56 vars in 1135 bytes} [Thu Oct 13 10:57:49 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 61 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 10:57:49.230646 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade65f34-0320-4a66-b559-06bce62451ec None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:57:49.243389 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade65f34-0320-4a66-b559-06bce62451ec None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:57:49.252300 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96615ef-9d7a-48e1-a06b-de98d028ff77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ce4ee85562d450a9dc2f16f581130d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:57:49.252935 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96615ef-9d7a-48e1-a06b-de98d028ff77 admin admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:49.253294 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96615ef-9d7a-48e1-a06b-de98d028ff77 admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:49.253568 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96615ef-9d7a-48e1-a06b-de98d028ff77 admin admin] PATH_INFO: `/v3/roles` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:49.254328 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96615ef-9d7a-48e1-a06b-de98d028ff77 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 10:57:49.254676 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96615ef-9d7a-48e1-a06b-de98d028ff77 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:57:49.256753 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96615ef-9d7a-48e1-a06b-de98d028ff77 admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:57:49.270725 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 141/288] 10.222.0.18 () {56 vars in 1132 bytes} [Thu Oct 13 10:57:49 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 10:57:49.276092 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10e7925-af91-49d2-bd8e-fbc0f58fffdf admin admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:57:49.290894 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10e7925-af91-49d2-bd8e-fbc0f58fffdf admin admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:57:49.300968 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21677c56-436f-4a87-b025-e8e6989a4de0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ce4ee85562d450a9dc2f16f581130d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:57:49.301645 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21677c56-436f-4a87-b025-e8e6989a4de0 admin admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:49.301923 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21677c56-436f-4a87-b025-e8e6989a4de0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:49.302198 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21677c56-436f-4a87-b025-e8e6989a4de0 admin admin] PATH_INFO: `/v3/groups/c0f6480dd0644b418eedd8e7fc1bff03` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:49.305808 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21677c56-436f-4a87-b025-e8e6989a4de0 admin admin] RBAC: Authorizing `identity:get_group(group_id=c0f6480dd0644b418eedd8e7fc1bff03)` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:57:49.307760 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21677c56-436f-4a87-b025-e8e6989a4de0 admin admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:57:49.309628 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 148/289] 10.222.0.18 () {56 vars in 1201 bytes} [Thu Oct 13 10:57:49 2022] GET /identity/v3/groups/c0f6480dd0644b418eedd8e7fc1bff03 => generated 226 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 10:57:49.315019 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96615ef-9d7a-48e1-a06b-de98d028ff77 admin admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:57:49.320853 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:57:49.331906 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96615ef-9d7a-48e1-a06b-de98d028ff77 admin admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:57:49.341968 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d5af09-5eae-4f91-9fbe-d7baad451945 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ce4ee85562d450a9dc2f16f581130d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:57:49.342616 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d5af09-5eae-4f91-9fbe-d7baad451945 admin admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:49.342901 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d5af09-5eae-4f91-9fbe-d7baad451945 admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:49.343184 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d5af09-5eae-4f91-9fbe-d7baad451945 admin admin] PATH_INFO: `/v3/projects/ab0fe3e4091a40ca831652b16957b46a` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:49.344589 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d5af09-5eae-4f91-9fbe-d7baad451945 admin admin] RBAC: Authorizing `identity:get_project(project_id=ab0fe3e4091a40ca831652b16957b46a)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:57:49.346967 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d5af09-5eae-4f91-9fbe-d7baad451945 admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:57:49.348839 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 142/290] 10.222.0.18 () {56 vars in 1207 bytes} [Thu Oct 13 10:57:49 2022] GET /identity/v3/projects/ab0fe3e4091a40ca831652b16957b46a => generated 302 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 10:57:49.354834 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21677c56-436f-4a87-b025-e8e6989a4de0 admin admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:57:49.371092 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21677c56-436f-4a87-b025-e8e6989a4de0 admin admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:57:49.378958 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7426ba9-4e11-482a-b121-761daa687029 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ce4ee85562d450a9dc2f16f581130d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:57:49.379634 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7426ba9-4e11-482a-b121-761daa687029 admin admin] REQUEST_METHOD: `PUT` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:49.379914 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7426ba9-4e11-482a-b121-761daa687029 admin admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:49.380188 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7426ba9-4e11-482a-b121-761daa687029 admin admin] PATH_INFO: `/v3/projects/ab0fe3e4091a40ca831652b16957b46a/groups/c0f6480dd0644b418eedd8e7fc1bff03/roles/e49be8727cbd4a39b3fbe6925f5af415` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:49.386603 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7426ba9-4e11-482a-b121-761daa687029 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ab0fe3e4091a40ca831652b16957b46a, group_id=c0f6480dd0644b418eedd8e7fc1bff03, role_id=e49be8727cbd4a39b3fbe6925f5af415)` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:57:49.389330 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7426ba9-4e11-482a-b121-761daa687029 admin admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:57:49.413335 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 149/291] 10.222.0.18 () {58 vars in 1463 bytes} [Thu Oct 13 10:57:49 2022] PUT /identity/v3/projects/ab0fe3e4091a40ca831652b16957b46a/groups/c0f6480dd0644b418eedd8e7fc1bff03/roles/e49be8727cbd4a39b3fbe6925f5af415 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 10:57:49.646860 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d5af09-5eae-4f91-9fbe-d7baad451945 admin admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:57:49.658595 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d5af09-5eae-4f91-9fbe-d7baad451945 admin admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:57:49.731685 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb1a6dd-3218-4db6-a1d8-df1ba268598d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ce4ee85562d450a9dc2f16f581130d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:57:49.732320 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb1a6dd-3218-4db6-a1d8-df1ba268598d admin admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:49.732597 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb1a6dd-3218-4db6-a1d8-df1ba268598d admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:49.732872 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb1a6dd-3218-4db6-a1d8-df1ba268598d admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:49.750851 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb1a6dd-3218-4db6-a1d8-df1ba268598d admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 13 10:57:49.755764 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application [None req-abb1a6dd-3218-4db6-a1d8-df1ba268598d admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 13 10:57:49.755764 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 10:57:49.755764 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 10:57:49.755764 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 10:57:49.755764 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 10:57:49.755764 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 10:57:49.755764 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 10:57:49.755764 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 10:57:49.755764 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 10:57:49.755764 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 10:57:49.755764 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 10:57:49.755764 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 10:57:49.755764 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 13 10:57:49.755764 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 13 10:57:49.755764 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 13 10:57:49.755764 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 13 10:57:49.756888 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 13 10:57:49.756888 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 13 10:57:49.756888 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 13 10:57:49.756888 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 13 10:57:49.756888 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 10:57:49.756888 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 10:57:49.756888 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 10:57:49.756888 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 10:57:49.756888 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 10:57:49.756888 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 10:57:49.756888 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 10:57:49.756888 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application with Lock( Oct 13 10:57:49.756888 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 10:57:49.756888 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._enter() Oct 13 10:57:49.756888 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 10:57:49.756888 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 10:57:49.758137 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 10:57:49.758137 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.creator() Oct 13 10:57:49.758137 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 10:57:49.758137 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application created_value = creator( Oct 13 10:57:49.758137 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 13 10:57:49.758137 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 13 10:57:49.758137 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 13 10:57:49.758137 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 13 10:57:49.758137 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 13 10:57:49.758137 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 13 10:57:49.758137 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 13 10:57:49.758137 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application Oct 13 10:57:49.758137 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 143/292] 10.222.0.18 () {56 vars in 1117 bytes} [Thu Oct 13 10:57:49 2022] GET /identity/v3/roles/admin => generated 83 bytes in 111 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 10:57:49.763330 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7426ba9-4e11-482a-b121-761daa687029 admin admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:57:49.776959 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7426ba9-4e11-482a-b121-761daa687029 admin admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:57:49.784736 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52fe3ef9-6023-4699-a536-53920d3c208b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ce4ee85562d450a9dc2f16f581130d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:57:49.785380 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fe3ef9-6023-4699-a536-53920d3c208b admin admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:49.785662 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fe3ef9-6023-4699-a536-53920d3c208b admin admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:49.785935 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fe3ef9-6023-4699-a536-53920d3c208b admin admin] PATH_INFO: `/v3/roles` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:49.786609 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52fe3ef9-6023-4699-a536-53920d3c208b admin admin] RBAC: Adding query filter params (name=admin) {{(pid=81533) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 10:57:49.786911 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52fe3ef9-6023-4699-a536-53920d3c208b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:57:49.788514 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52fe3ef9-6023-4699-a536-53920d3c208b admin admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:57:49.800577 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:57:49.807683 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 150/293] 10.222.0.18 () {56 vars in 1120 bytes} [Thu Oct 13 10:57:49 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 10:57:49.813890 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb1a6dd-3218-4db6-a1d8-df1ba268598d admin admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:57:49.825427 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb1a6dd-3218-4db6-a1d8-df1ba268598d admin admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:57:49.837793 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d5090c-7a8e-457a-93e9-4555cdc88afb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ce4ee85562d450a9dc2f16f581130d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:57:49.838431 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d5090c-7a8e-457a-93e9-4555cdc88afb admin admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:49.838710 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d5090c-7a8e-457a-93e9-4555cdc88afb admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:49.838985 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d5090c-7a8e-457a-93e9-4555cdc88afb admin admin] PATH_INFO: `/v3/groups/c6d7c50aba2c418c895d8edd79133c30` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:49.849659 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d5090c-7a8e-457a-93e9-4555cdc88afb admin admin] RBAC: Authorizing `identity:get_group(group_id=c6d7c50aba2c418c895d8edd79133c30)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:57:49.851619 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d5090c-7a8e-457a-93e9-4555cdc88afb admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:57:49.853362 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 144/294] 10.222.0.18 () {56 vars in 1201 bytes} [Thu Oct 13 10:57:49 2022] GET /identity/v3/groups/c6d7c50aba2c418c895d8edd79133c30 => generated 229 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 10:57:49.859013 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52fe3ef9-6023-4699-a536-53920d3c208b admin admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:57:49.874466 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52fe3ef9-6023-4699-a536-53920d3c208b admin admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:57:49.885051 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c663f1-692d-4583-bfb3-df681960c108 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ce4ee85562d450a9dc2f16f581130d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:57:49.885792 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c663f1-692d-4583-bfb3-df681960c108 admin admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:49.886071 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c663f1-692d-4583-bfb3-df681960c108 admin admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:49.886340 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c663f1-692d-4583-bfb3-df681960c108 admin admin] PATH_INFO: `/v3/projects/9ce4ee85562d450a9dc2f16f581130d9` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:49.893816 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c663f1-692d-4583-bfb3-df681960c108 admin admin] RBAC: Authorizing `identity:get_project(project_id=9ce4ee85562d450a9dc2f16f581130d9)` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:57:49.895653 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c663f1-692d-4583-bfb3-df681960c108 admin admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:57:49.897683 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 151/295] 10.222.0.18 () {56 vars in 1207 bytes} [Thu Oct 13 10:57:49 2022] GET /identity/v3/projects/9ce4ee85562d450a9dc2f16f581130d9 => generated 344 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 13 10:57:49.903711 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d5090c-7a8e-457a-93e9-4555cdc88afb admin admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:57:49.913805 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d5090c-7a8e-457a-93e9-4555cdc88afb admin admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:57:49.925062 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b79659d-0d49-4173-bd22-7f40013b6f49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ce4ee85562d450a9dc2f16f581130d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:57:49.925724 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b79659d-0d49-4173-bd22-7f40013b6f49 admin admin] REQUEST_METHOD: `PUT` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:49.926002 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b79659d-0d49-4173-bd22-7f40013b6f49 admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:49.926274 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b79659d-0d49-4173-bd22-7f40013b6f49 admin admin] PATH_INFO: `/v3/projects/9ce4ee85562d450a9dc2f16f581130d9/groups/c6d7c50aba2c418c895d8edd79133c30/roles/30a6d59262144d4d956f4d4207864030` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:49.933822 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b79659d-0d49-4173-bd22-7f40013b6f49 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9ce4ee85562d450a9dc2f16f581130d9, group_id=c6d7c50aba2c418c895d8edd79133c30, role_id=30a6d59262144d4d956f4d4207864030)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:57:49.936476 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b79659d-0d49-4173-bd22-7f40013b6f49 admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:57:49.959601 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 145/296] 10.222.0.18 () {58 vars in 1463 bytes} [Thu Oct 13 10:57:49 2022] PUT /identity/v3/projects/9ce4ee85562d450a9dc2f16f581130d9/groups/c6d7c50aba2c418c895d8edd79133c30/roles/30a6d59262144d4d956f4d4207864030 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 10:57:50.114442 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8af692e-0309-44f9-bd74-ba04a1cd89d3 None None] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:50.114780 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8af692e-0309-44f9-bd74-ba04a1cd89d3 None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:50.114976 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8af692e-0309-44f9-bd74-ba04a1cd89d3 None None] PATH_INFO: `/` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:50.116314 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 152/297] 10.222.0.18 () {54 vars in 927 bytes} [Thu Oct 13 10:57:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 10:57:50.123159 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1de638-545b-4ce6-8db4-493d268cc12c None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:50.123431 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1de638-545b-4ce6-8db4-493d268cc12c None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:50.123695 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1de638-545b-4ce6-8db4-493d268cc12c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:50.146091 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-1d1de638-545b-4ce6-8db4-493d268cc12c None None] MFA Rules not processed for user `8ba31ade43694cf8bf28f7528a9ea179`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 10:57:50.147297 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-1d1de638-545b-4ce6-8db4-493d268cc12c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 10:57:50.239035 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 146/298] 10.222.0.18 () {58 vars in 1024 bytes} [Thu Oct 13 10:57:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 13 10:57:50.558857 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8af692e-0309-44f9-bd74-ba04a1cd89d3 None None] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:57:50.704581 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8af692e-0309-44f9-bd74-ba04a1cd89d3 None None] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:57:50.744260 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3f3aa0-1a72-4a8f-a717-605c573d833a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:57:50.744900 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3f3aa0-1a72-4a8f-a717-605c573d833a None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:50.745214 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3f3aa0-1a72-4a8f-a717-605c573d833a None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:50.745489 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3f3aa0-1a72-4a8f-a717-605c573d833a None admin] PATH_INFO: `/v3/roles/member` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:50.759803 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3f3aa0-1a72-4a8f-a717-605c573d833a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 13 10:57:50.764621 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application [None req-0d3f3aa0-1a72-4a8f-a717-605c573d833a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 13 10:57:50.764621 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 10:57:50.764621 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 10:57:50.764621 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 10:57:50.764621 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 10:57:50.764621 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 10:57:50.764621 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 10:57:50.764621 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 10:57:50.764621 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 10:57:50.764621 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 10:57:50.764621 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 10:57:50.764621 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 10:57:50.764621 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 13 10:57:50.764621 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 13 10:57:50.764621 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 13 10:57:50.764621 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 13 10:57:50.765534 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 13 10:57:50.765534 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 13 10:57:50.765534 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 13 10:57:50.765534 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 13 10:57:50.765534 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 10:57:50.765534 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 10:57:50.765534 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 10:57:50.765534 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 10:57:50.765534 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 10:57:50.765534 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 10:57:50.765534 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 10:57:50.765534 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application with Lock( Oct 13 10:57:50.765534 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 10:57:50.765534 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._enter() Oct 13 10:57:50.765534 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 10:57:50.765534 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 10:57:50.766726 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 10:57:50.766726 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.creator() Oct 13 10:57:50.766726 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 10:57:50.766726 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application created_value = creator( Oct 13 10:57:50.766726 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 13 10:57:50.766726 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 13 10:57:50.766726 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 13 10:57:50.766726 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 13 10:57:50.766726 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 13 10:57:50.766726 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 13 10:57:50.766726 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 13 10:57:50.766726 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application Oct 13 10:57:50.766726 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 153/299] 10.222.0.18 () {56 vars in 1099 bytes} [Thu Oct 13 10:57:50 2022] GET /identity/v3/roles/member => generated 84 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 10:57:50.773874 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1de638-545b-4ce6-8db4-493d268cc12c None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:57:50.850328 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:57:50.924535 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1de638-545b-4ce6-8db4-493d268cc12c None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:57:50.972510 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1629ee3-ac31-42c8-a046-bd093c7cce9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:57:50.973516 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1629ee3-ac31-42c8-a046-bd093c7cce9a None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:50.973986 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1629ee3-ac31-42c8-a046-bd093c7cce9a None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:50.974444 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1629ee3-ac31-42c8-a046-bd093c7cce9a None admin] PATH_INFO: `/v3/roles` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:50.975301 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1629ee3-ac31-42c8-a046-bd093c7cce9a None admin] RBAC: Adding query filter params (name=member) {{(pid=81534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 10:57:50.975815 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1629ee3-ac31-42c8-a046-bd093c7cce9a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:57:50.977493 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1629ee3-ac31-42c8-a046-bd093c7cce9a None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:57:50.990306 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 147/300] 10.222.0.18 () {56 vars in 1101 bytes} [Thu Oct 13 10:57:50 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 10:57:50.997255 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3f3aa0-1a72-4a8f-a717-605c573d833a None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:57:51.090100 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:57:51.156770 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3f3aa0-1a72-4a8f-a717-605c573d833a None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:57:51.200043 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c02d18d-4d0e-4f15-bc16-fce3c02e36a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:57:51.200657 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c02d18d-4d0e-4f15-bc16-fce3c02e36a8 None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:51.200932 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c02d18d-4d0e-4f15-bc16-fce3c02e36a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:51.201279 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c02d18d-4d0e-4f15-bc16-fce3c02e36a8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:51.241931 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d146bffa-da65-4bee-9fa1-5af4b29abb68 None None] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:51.243094 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d146bffa-da65-4bee-9fa1-5af4b29abb68 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:51.243794 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d146bffa-da65-4bee-9fa1-5af4b29abb68 None None] PATH_INFO: `/` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:51.246862 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 148/301] 10.222.0.18 () {54 vars in 927 bytes} [Thu Oct 13 10:57:51 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 10:57:51.260526 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5baa6aa-cf98-4003-a073-691bb14dd763 None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:51.260807 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5baa6aa-cf98-4003-a073-691bb14dd763 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:51.261102 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5baa6aa-cf98-4003-a073-691bb14dd763 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:51.297527 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-d5baa6aa-cf98-4003-a073-691bb14dd763 None None] MFA Rules not processed for user `8ba31ade43694cf8bf28f7528a9ea179`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 10:57:51.298733 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-d5baa6aa-cf98-4003-a073-691bb14dd763 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 10:57:51.317604 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c02d18d-4d0e-4f15-bc16-fce3c02e36a8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:57:51.319086 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c02d18d-4d0e-4f15-bc16-fce3c02e36a8 None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:57:51.425459 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:57:51.436297 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 149/302] 10.222.0.18 () {58 vars in 1024 bytes} [Thu Oct 13 10:57:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 13 10:57:51.488364 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 154/303] 10.222.0.18 () {58 vars in 1282 bytes} [Thu Oct 13 10:57:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 491 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 13 10:57:51.494389 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5baa6aa-cf98-4003-a073-691bb14dd763 None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:57:51.553801 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:57:51.607095 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5baa6aa-cf98-4003-a073-691bb14dd763 None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:57:51.647317 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25bfd08d-38c0-4f30-a2e2-fadd4fd24794 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:57:51.648339 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bfd08d-38c0-4f30-a2e2-fadd4fd24794 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:51.648810 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bfd08d-38c0-4f30-a2e2-fadd4fd24794 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:51.649868 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bfd08d-38c0-4f30-a2e2-fadd4fd24794 None admin] PATH_INFO: `/v3/projects/8b052a27256842f098af78fca7334623` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:51.651697 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25bfd08d-38c0-4f30-a2e2-fadd4fd24794 None admin] RBAC: Authorizing `identity:get_project(project_id=8b052a27256842f098af78fca7334623)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:57:51.653370 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25bfd08d-38c0-4f30-a2e2-fadd4fd24794 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:57:51.657957 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 150/304] 10.222.0.18 () {56 vars in 1186 bytes} [Thu Oct 13 10:57:51 2022] GET /identity/v3/projects/8b052a27256842f098af78fca7334623 => generated 298 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 10:57:51.661346 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c02d18d-4d0e-4f15-bc16-fce3c02e36a8 None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:57:51.780137 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25bfd08d-38c0-4f30-a2e2-fadd4fd24794 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:57:51.794985 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c02d18d-4d0e-4f15-bc16-fce3c02e36a8 None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:57:51.836484 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778e3223-0ea1-45f8-851c-dcc1a41835e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:57:51.837992 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778e3223-0ea1-45f8-851c-dcc1a41835e6 None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:51.838328 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778e3223-0ea1-45f8-851c-dcc1a41835e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:51.838603 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778e3223-0ea1-45f8-851c-dcc1a41835e6 None admin] PATH_INFO: `/v3/groups/c0f6480dd0644b418eedd8e7fc1bff03` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:51.839882 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778e3223-0ea1-45f8-851c-dcc1a41835e6 None admin] RBAC: Authorizing `identity:get_group(group_id=c0f6480dd0644b418eedd8e7fc1bff03)` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:57:51.841573 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778e3223-0ea1-45f8-851c-dcc1a41835e6 None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:57:51.843439 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 155/305] 10.222.0.18 () {56 vars in 1180 bytes} [Thu Oct 13 10:57:51 2022] GET /identity/v3/groups/c0f6480dd0644b418eedd8e7fc1bff03 => generated 226 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 10:57:51.846946 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835cb6a6-7a3b-4724-8fc8-1086aa098a93 None None] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:51.847287 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835cb6a6-7a3b-4724-8fc8-1086aa098a93 None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:51.847561 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835cb6a6-7a3b-4724-8fc8-1086aa098a93 None None] PATH_INFO: `/` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:51.851301 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 156/306] 10.222.0.18 () {54 vars in 927 bytes} [Thu Oct 13 10:57:51 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 10:57:51.853674 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835cb6a6-7a3b-4724-8fc8-1086aa098a93 None None] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:57:51.882117 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:57:51.932157 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25bfd08d-38c0-4f30-a2e2-fadd4fd24794 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:57:51.942009 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:57:51.969414 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b18864-05d4-4d11-bb2b-1941de0b8f62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:57:51.970170 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b18864-05d4-4d11-bb2b-1941de0b8f62 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:51.970455 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b18864-05d4-4d11-bb2b-1941de0b8f62 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:51.970781 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b18864-05d4-4d11-bb2b-1941de0b8f62 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:51.973967 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835cb6a6-7a3b-4724-8fc8-1086aa098a93 None None] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:57:51.982542 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b18864-05d4-4d11-bb2b-1941de0b8f62 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 13 10:57:51.988180 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application [None req-a2b18864-05d4-4d11-bb2b-1941de0b8f62 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 13 10:57:51.988180 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 10:57:51.988180 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 10:57:51.988180 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 10:57:51.988180 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 10:57:51.988180 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 10:57:51.988180 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 10:57:51.988180 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 10:57:51.988180 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 10:57:51.988180 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 10:57:51.988180 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 10:57:51.988180 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 10:57:51.988180 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 13 10:57:51.988180 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 13 10:57:51.988180 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 13 10:57:51.988180 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 13 10:57:51.989302 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 13 10:57:51.989302 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 13 10:57:51.989302 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 13 10:57:51.989302 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 13 10:57:51.989302 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 10:57:51.989302 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 10:57:51.989302 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 10:57:51.989302 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 10:57:51.989302 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 10:57:51.989302 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 10:57:51.989302 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 10:57:51.989302 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application with Lock( Oct 13 10:57:51.989302 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 10:57:51.989302 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._enter() Oct 13 10:57:51.989302 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 10:57:51.989302 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 10:57:51.990365 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 10:57:51.990365 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.creator() Oct 13 10:57:51.990365 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 10:57:51.990365 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application created_value = creator( Oct 13 10:57:51.990365 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 13 10:57:51.990365 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 13 10:57:51.990365 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 13 10:57:51.990365 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 13 10:57:51.990365 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 13 10:57:51.990365 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 13 10:57:51.990365 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 13 10:57:51.990365 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application Oct 13 10:57:51.990365 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 151/307] 10.222.0.18 () {56 vars in 1114 bytes} [Thu Oct 13 10:57:51 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 10:57:51.991020 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bce7c85-67c5-4706-989f-fca5b299206a None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:51.991094 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bce7c85-67c5-4706-989f-fca5b299206a None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:51.991320 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bce7c85-67c5-4706-989f-fca5b299206a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:52.016280 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-5bce7c85-67c5-4706-989f-fca5b299206a None None] MFA Rules not processed for user `8ba31ade43694cf8bf28f7528a9ea179`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 10:57:52.017094 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db45a6fd-08fe-4fe1-a1fa-20043b597864 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:57:52.017510 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-5bce7c85-67c5-4706-989f-fca5b299206a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 10:57:52.018080 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db45a6fd-08fe-4fe1-a1fa-20043b597864 None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:52.018505 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db45a6fd-08fe-4fe1-a1fa-20043b597864 None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:52.018913 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db45a6fd-08fe-4fe1-a1fa-20043b597864 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:52.019925 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db45a6fd-08fe-4fe1-a1fa-20043b597864 None admin] RBAC: Adding query filter params (group.id=c0f6480dd0644b418eedd8e7fc1bff03, role.id=a893cd4f751e445aab4dda1a832f24a1, scope.project.id=8b052a27256842f098af78fca7334623) {{(pid=81533) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 10:57:52.020509 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db45a6fd-08fe-4fe1-a1fa-20043b597864 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:57:52.022172 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db45a6fd-08fe-4fe1-a1fa-20043b597864 None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:57:52.037048 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 157/308] 10.222.0.18 () {56 vars in 1376 bytes} [Thu Oct 13 10:57:51 2022] GET /identity/v3/role_assignments?group.id=c0f6480dd0644b418eedd8e7fc1bff03&scope.project.id=8b052a27256842f098af78fca7334623&role.id=a893cd4f751e445aab4dda1a832f24a1 => generated 611 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 10:57:52.037048 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db45a6fd-08fe-4fe1-a1fa-20043b597864 None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:57:52.110065 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 152/309] 10.222.0.18 () {58 vars in 1024 bytes} [Thu Oct 13 10:57:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 13 10:57:52.185558 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:57:52.206107 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db45a6fd-08fe-4fe1-a1fa-20043b597864 None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:57:52.254143 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b62d382-67f8-48e3-b62c-59383ca14823 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:57:52.255022 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b62d382-67f8-48e3-b62c-59383ca14823 None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:52.255469 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b62d382-67f8-48e3-b62c-59383ca14823 None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:52.255909 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b62d382-67f8-48e3-b62c-59383ca14823 None admin] PATH_INFO: `/v3/roles` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:52.257108 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b62d382-67f8-48e3-b62c-59383ca14823 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81533) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 10:57:52.257576 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b62d382-67f8-48e3-b62c-59383ca14823 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:57:52.260406 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b62d382-67f8-48e3-b62c-59383ca14823 None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:57:52.269243 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 158/310] 10.222.0.18 () {56 vars in 1111 bytes} [Thu Oct 13 10:57:52 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 10:57:52.278319 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bce7c85-67c5-4706-989f-fca5b299206a None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:57:52.401776 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:57:52.405810 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bce7c85-67c5-4706-989f-fca5b299206a None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:57:52.443472 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433ee150-e1b1-45e5-b240-6bd2f726f385 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:57:52.444086 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433ee150-e1b1-45e5-b240-6bd2f726f385 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:52.444370 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433ee150-e1b1-45e5-b240-6bd2f726f385 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:52.444643 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433ee150-e1b1-45e5-b240-6bd2f726f385 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:52.458736 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf38b7d-5b61-40e6-8d46-b4619675481e None None] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:52.459025 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf38b7d-5b61-40e6-8d46-b4619675481e None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:52.459292 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf38b7d-5b61-40e6-8d46-b4619675481e None None] PATH_INFO: `/` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:52.460930 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 159/311] 10.222.0.18 () {54 vars in 927 bytes} [Thu Oct 13 10:57:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 10:57:52.461706 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf38b7d-5b61-40e6-8d46-b4619675481e None None] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:57:52.520294 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433ee150-e1b1-45e5-b240-6bd2f726f385 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:57:52.522293 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433ee150-e1b1-45e5-b240-6bd2f726f385 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:57:52.598803 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf38b7d-5b61-40e6-8d46-b4619675481e None None] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:57:52.641234 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8719313-f186-4ad4-9186-21b64b847920 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:57:52.641873 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8719313-f186-4ad4-9186-21b64b847920 None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:52.642155 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8719313-f186-4ad4-9186-21b64b847920 None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:52.642614 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8719313-f186-4ad4-9186-21b64b847920 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:52.648296 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:57:52.655580 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 153/312] 10.222.0.18 () {58 vars in 1282 bytes} [Thu Oct 13 10:57:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 13 10:57:52.656750 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0736cbd-0b42-4ca8-8c32-31efddcfb50f None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:52.656952 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8719313-f186-4ad4-9186-21b64b847920 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 13 10:57:52.658072 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0736cbd-0b42-4ca8-8c32-31efddcfb50f None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:52.658361 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0736cbd-0b42-4ca8-8c32-31efddcfb50f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:52.663338 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application [None req-e8719313-f186-4ad4-9186-21b64b847920 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 13 10:57:52.663338 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 10:57:52.663338 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 10:57:52.663338 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 10:57:52.663338 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 10:57:52.663338 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 10:57:52.663338 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 10:57:52.663338 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 10:57:52.663338 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 10:57:52.663338 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 10:57:52.663338 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 10:57:52.663338 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 10:57:52.663338 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 13 10:57:52.663338 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 13 10:57:52.663338 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 13 10:57:52.663338 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 13 10:57:52.664577 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 13 10:57:52.664577 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 13 10:57:52.664577 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 13 10:57:52.664577 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 13 10:57:52.664577 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 10:57:52.664577 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 10:57:52.664577 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 10:57:52.664577 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 10:57:52.664577 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 10:57:52.664577 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 10:57:52.664577 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 10:57:52.664577 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application with Lock( Oct 13 10:57:52.664577 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 10:57:52.664577 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._enter() Oct 13 10:57:52.664577 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 10:57:52.664577 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 10:57:52.666014 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 10:57:52.666014 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.creator() Oct 13 10:57:52.666014 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 10:57:52.666014 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application created_value = creator( Oct 13 10:57:52.666014 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 13 10:57:52.666014 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 13 10:57:52.666014 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 13 10:57:52.666014 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 13 10:57:52.666014 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 13 10:57:52.666014 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 13 10:57:52.666014 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 13 10:57:52.666014 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application Oct 13 10:57:52.666014 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 160/313] 10.222.0.18 () {56 vars in 1099 bytes} [Thu Oct 13 10:57:52 2022] GET /identity/v3/roles/member => generated 84 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 10:57:52.666014 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8719313-f186-4ad4-9186-21b64b847920 None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:57:52.679187 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:57:52.686029 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-c0736cbd-0b42-4ca8-8c32-31efddcfb50f None None] MFA Rules not processed for user `8ba31ade43694cf8bf28f7528a9ea179`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 10:57:52.687360 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-c0736cbd-0b42-4ca8-8c32-31efddcfb50f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 10:57:52.780560 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 154/314] 10.222.0.18 () {58 vars in 1024 bytes} [Thu Oct 13 10:57:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 13 10:57:52.781098 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0736cbd-0b42-4ca8-8c32-31efddcfb50f None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:57:52.815094 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8719313-f186-4ad4-9186-21b64b847920 None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:57:52.864831 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486dbe25-fca6-418f-9cef-446489c9d36b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:57:52.865576 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486dbe25-fca6-418f-9cef-446489c9d36b None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:52.865826 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486dbe25-fca6-418f-9cef-446489c9d36b None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:52.866101 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486dbe25-fca6-418f-9cef-446489c9d36b None admin] PATH_INFO: `/v3/projects/8b052a27256842f098af78fca7334623` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:52.867693 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486dbe25-fca6-418f-9cef-446489c9d36b None admin] RBAC: Authorizing `identity:get_project(project_id=8b052a27256842f098af78fca7334623)` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:57:52.870750 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486dbe25-fca6-418f-9cef-446489c9d36b None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:57:52.872447 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 161/315] 10.222.0.18 () {56 vars in 1186 bytes} [Thu Oct 13 10:57:52 2022] GET /identity/v3/projects/8b052a27256842f098af78fca7334623 => generated 298 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 10:57:52.877912 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486dbe25-fca6-418f-9cef-446489c9d36b None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:57:52.906486 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0736cbd-0b42-4ca8-8c32-31efddcfb50f None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:57:52.937721 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:57:52.947634 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67cef4a-4451-4db1-b580-6aab79ae4e70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:57:52.948535 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67cef4a-4451-4db1-b580-6aab79ae4e70 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:52.948957 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67cef4a-4451-4db1-b580-6aab79ae4e70 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:52.949531 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67cef4a-4451-4db1-b580-6aab79ae4e70 None admin] PATH_INFO: `/v3/roles` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:52.950500 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67cef4a-4451-4db1-b580-6aab79ae4e70 None admin] RBAC: Adding query filter params (name=member) {{(pid=81534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 10:57:52.951051 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67cef4a-4451-4db1-b580-6aab79ae4e70 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:57:52.952854 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67cef4a-4451-4db1-b580-6aab79ae4e70 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:57:52.962899 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 155/316] 10.222.0.18 () {56 vars in 1101 bytes} [Thu Oct 13 10:57:52 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 10:57:52.969361 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:57:52.970997 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67cef4a-4451-4db1-b580-6aab79ae4e70 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:57:52.995028 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486dbe25-fca6-418f-9cef-446489c9d36b None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:57:53.043031 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b810929-68f3-4c27-8978-3cd71f4d3316 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:57:53.043753 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b810929-68f3-4c27-8978-3cd71f4d3316 None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:53.044030 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b810929-68f3-4c27-8978-3cd71f4d3316 None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:53.044298 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b810929-68f3-4c27-8978-3cd71f4d3316 None admin] PATH_INFO: `/v3/groups/c0f6480dd0644b418eedd8e7fc1bff03` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:53.045527 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b810929-68f3-4c27-8978-3cd71f4d3316 None admin] RBAC: Authorizing `identity:get_group(group_id=c0f6480dd0644b418eedd8e7fc1bff03)` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:57:53.047138 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b810929-68f3-4c27-8978-3cd71f4d3316 None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:57:53.049272 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 162/317] 10.222.0.18 () {56 vars in 1180 bytes} [Thu Oct 13 10:57:52 2022] GET /identity/v3/groups/c0f6480dd0644b418eedd8e7fc1bff03 => generated 226 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 10:57:53.056532 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b810929-68f3-4c27-8978-3cd71f4d3316 None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:57:53.102419 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67cef4a-4451-4db1-b580-6aab79ae4e70 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:57:53.147002 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaed48ea-1940-4232-9ae8-e4f5b87d2f2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:57:53.148866 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaed48ea-1940-4232-9ae8-e4f5b87d2f2b None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:53.150014 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaed48ea-1940-4232-9ae8-e4f5b87d2f2b None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:53.150443 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaed48ea-1940-4232-9ae8-e4f5b87d2f2b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:53.181365 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b810929-68f3-4c27-8978-3cd71f4d3316 None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:57:53.224079 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:57:53.231032 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06bf9aa9-eaff-4202-ae0e-1b758ebf2c5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:57:53.231470 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bf9aa9-eaff-4202-ae0e-1b758ebf2c5f None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:53.231747 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bf9aa9-eaff-4202-ae0e-1b758ebf2c5f None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:53.232018 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bf9aa9-eaff-4202-ae0e-1b758ebf2c5f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:53.232821 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06bf9aa9-eaff-4202-ae0e-1b758ebf2c5f None admin] RBAC: Adding query filter params (group.id=c0f6480dd0644b418eedd8e7fc1bff03, role.id=e49be8727cbd4a39b3fbe6925f5af415, scope.project.id=8b052a27256842f098af78fca7334623) {{(pid=81533) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 10:57:53.233172 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06bf9aa9-eaff-4202-ae0e-1b758ebf2c5f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:57:53.234668 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06bf9aa9-eaff-4202-ae0e-1b758ebf2c5f None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:57:53.237117 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaed48ea-1940-4232-9ae8-e4f5b87d2f2b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:57:53.238563 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaed48ea-1940-4232-9ae8-e4f5b87d2f2b None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:57:53.242643 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 163/318] 10.222.0.18 () {56 vars in 1376 bytes} [Thu Oct 13 10:57:53 2022] GET /identity/v3/role_assignments?group.id=c0f6480dd0644b418eedd8e7fc1bff03&scope.project.id=8b052a27256842f098af78fca7334623&role.id=e49be8727cbd4a39b3fbe6925f5af415 => generated 611 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 13 10:57:53.243490 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06bf9aa9-eaff-4202-ae0e-1b758ebf2c5f None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:57:53.268906 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:57:53.398184 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06bf9aa9-eaff-4202-ae0e-1b758ebf2c5f None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:57:53.403971 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 156/319] 10.222.0.18 () {58 vars in 1282 bytes} [Thu Oct 13 10:57:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 434 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Oct 13 10:57:53.409084 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4442afa-600c-4cdf-9829-e4a4f0fdccb3 None None] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:53.409084 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4442afa-600c-4cdf-9829-e4a4f0fdccb3 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:53.409084 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4442afa-600c-4cdf-9829-e4a4f0fdccb3 None None] PATH_INFO: `/` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:53.409084 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 157/320] 10.222.0.18 () {54 vars in 927 bytes} [Thu Oct 13 10:57:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 10:57:53.412644 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4442afa-600c-4cdf-9829-e4a4f0fdccb3 None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:57:53.439389 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51484dbf-626f-4b5c-b5d2-a7291f4ca3a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:57:53.440265 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51484dbf-626f-4b5c-b5d2-a7291f4ca3a1 None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:53.440711 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51484dbf-626f-4b5c-b5d2-a7291f4ca3a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:53.441248 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51484dbf-626f-4b5c-b5d2-a7291f4ca3a1 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:53.455249 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51484dbf-626f-4b5c-b5d2-a7291f4ca3a1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 13 10:57:53.460828 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application [None req-51484dbf-626f-4b5c-b5d2-a7291f4ca3a1 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 13 10:57:53.460828 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 10:57:53.460828 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 10:57:53.460828 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 10:57:53.460828 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 10:57:53.460828 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 10:57:53.460828 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 10:57:53.460828 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 10:57:53.460828 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 10:57:53.460828 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 10:57:53.460828 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 10:57:53.460828 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 10:57:53.460828 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 13 10:57:53.460828 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 13 10:57:53.460828 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 13 10:57:53.460828 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 13 10:57:53.462559 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 13 10:57:53.462559 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 13 10:57:53.462559 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 13 10:57:53.462559 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 13 10:57:53.462559 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 10:57:53.462559 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 10:57:53.462559 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 10:57:53.462559 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 10:57:53.462559 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 10:57:53.462559 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 10:57:53.462559 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 10:57:53.462559 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application with Lock( Oct 13 10:57:53.462559 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 10:57:53.462559 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._enter() Oct 13 10:57:53.462559 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 10:57:53.462559 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 10:57:53.463380 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 10:57:53.463380 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.creator() Oct 13 10:57:53.463380 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 10:57:53.463380 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application created_value = creator( Oct 13 10:57:53.463380 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 13 10:57:53.463380 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 13 10:57:53.463380 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 13 10:57:53.463380 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 13 10:57:53.463380 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 13 10:57:53.463380 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 13 10:57:53.463380 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 13 10:57:53.463380 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application Oct 13 10:57:53.465663 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 164/321] 10.222.0.18 () {56 vars in 1114 bytes} [Thu Oct 13 10:57:53 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 10:57:53.467106 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a2cdc9-1810-44da-b08c-d8788d5d45e5 None None] REQUEST_METHOD: `POST` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:53.467458 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a2cdc9-1810-44da-b08c-d8788d5d45e5 None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:53.467806 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a2cdc9-1810-44da-b08c-d8788d5d45e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:53.488094 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.auth.core [None req-23a2cdc9-1810-44da-b08c-d8788d5d45e5 None None] MFA Rules not processed for user `8ba31ade43694cf8bf28f7528a9ea179`. Rule list: `[]` (Enabled: `True`). {{(pid=81533) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 10:57:53.489342 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-23a2cdc9-1810-44da-b08c-d8788d5d45e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 10:57:53.535336 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:57:53.548466 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4442afa-600c-4cdf-9829-e4a4f0fdccb3 None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:57:53.563403 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:57:53.570500 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 165/322] 10.222.0.18 () {58 vars in 1024 bytes} [Thu Oct 13 10:57:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 13 10:57:53.572253 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a2cdc9-1810-44da-b08c-d8788d5d45e5 None None] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:57:53.594321 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b2a1ab-bf5f-44e8-8757-1b0ba415db12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:57:53.595055 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b2a1ab-bf5f-44e8-8757-1b0ba415db12 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:53.595341 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b2a1ab-bf5f-44e8-8757-1b0ba415db12 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:53.595615 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b2a1ab-bf5f-44e8-8757-1b0ba415db12 None admin] PATH_INFO: `/v3/projects/ab0fe3e4091a40ca831652b16957b46a` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:53.596789 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b2a1ab-bf5f-44e8-8757-1b0ba415db12 None admin] RBAC: Authorizing `identity:get_project(project_id=ab0fe3e4091a40ca831652b16957b46a)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:57:53.598369 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b2a1ab-bf5f-44e8-8757-1b0ba415db12 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:57:53.600225 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 158/323] 10.222.0.18 () {56 vars in 1186 bytes} [Thu Oct 13 10:57:53 2022] GET /identity/v3/projects/ab0fe3e4091a40ca831652b16957b46a => generated 302 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 10:57:53.607789 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b2a1ab-bf5f-44e8-8757-1b0ba415db12 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:57:53.689048 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a2cdc9-1810-44da-b08c-d8788d5d45e5 None None] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:57:53.738925 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b2a1ab-bf5f-44e8-8757-1b0ba415db12 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:57:53.752171 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d75c18-0506-408a-9f5a-f5caf971401c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:57:53.752892 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d75c18-0506-408a-9f5a-f5caf971401c None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:53.753204 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d75c18-0506-408a-9f5a-f5caf971401c None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:53.753691 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d75c18-0506-408a-9f5a-f5caf971401c None admin] PATH_INFO: `/v3/roles` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:53.754140 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d75c18-0506-408a-9f5a-f5caf971401c None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81533) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 10:57:53.754440 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d75c18-0506-408a-9f5a-f5caf971401c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:57:53.755788 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d75c18-0506-408a-9f5a-f5caf971401c None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:57:53.765711 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 166/324] 10.222.0.18 () {56 vars in 1111 bytes} [Thu Oct 13 10:57:53 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 10:57:53.771173 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d75c18-0506-408a-9f5a-f5caf971401c None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:57:53.778100 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b005acc-cda0-43a1-ad03-7d29d4eb7bbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:57:53.778780 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b005acc-cda0-43a1-ad03-7d29d4eb7bbb None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:53.779060 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b005acc-cda0-43a1-ad03-7d29d4eb7bbb None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:53.779330 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b005acc-cda0-43a1-ad03-7d29d4eb7bbb None admin] PATH_INFO: `/v3/groups/c0f6480dd0644b418eedd8e7fc1bff03` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:53.780441 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b005acc-cda0-43a1-ad03-7d29d4eb7bbb None admin] RBAC: Authorizing `identity:get_group(group_id=c0f6480dd0644b418eedd8e7fc1bff03)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:57:53.781892 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b005acc-cda0-43a1-ad03-7d29d4eb7bbb None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:57:53.783450 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 159/325] 10.222.0.18 () {56 vars in 1180 bytes} [Thu Oct 13 10:57:53 2022] GET /identity/v3/groups/c0f6480dd0644b418eedd8e7fc1bff03 => generated 226 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 10:57:53.789817 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b005acc-cda0-43a1-ad03-7d29d4eb7bbb None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:57:53.822977 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:57:53.852072 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:57:53.899505 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d75c18-0506-408a-9f5a-f5caf971401c None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:57:53.919213 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b005acc-cda0-43a1-ad03-7d29d4eb7bbb None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:57:53.937682 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebbb0e3-7674-4d7f-ace5-1c18047c007a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:57:53.938285 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebbb0e3-7674-4d7f-ace5-1c18047c007a None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:53.938568 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebbb0e3-7674-4d7f-ace5-1c18047c007a None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:53.940079 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebbb0e3-7674-4d7f-ace5-1c18047c007a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:53.957380 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9f1abc-e392-4cf2-9b4e-ae3e3f626ffc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:57:53.957985 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9f1abc-e392-4cf2-9b4e-ae3e3f626ffc None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:53.958266 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9f1abc-e392-4cf2-9b4e-ae3e3f626ffc None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:53.958541 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9f1abc-e392-4cf2-9b4e-ae3e3f626ffc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:53.959271 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da9f1abc-e392-4cf2-9b4e-ae3e3f626ffc None admin] RBAC: Adding query filter params (group.id=c0f6480dd0644b418eedd8e7fc1bff03, role.id=a893cd4f751e445aab4dda1a832f24a1, scope.project.id=ab0fe3e4091a40ca831652b16957b46a) {{(pid=81534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 10:57:53.959577 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da9f1abc-e392-4cf2-9b4e-ae3e3f626ffc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:57:53.961033 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da9f1abc-e392-4cf2-9b4e-ae3e3f626ffc None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:57:53.967179 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 160/326] 10.222.0.18 () {56 vars in 1376 bytes} [Thu Oct 13 10:57:53 2022] GET /identity/v3/role_assignments?group.id=c0f6480dd0644b418eedd8e7fc1bff03&scope.project.id=ab0fe3e4091a40ca831652b16957b46a&role.id=a893cd4f751e445aab4dda1a832f24a1 => generated 611 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 13 10:57:53.967802 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9f1abc-e392-4cf2-9b4e-ae3e3f626ffc None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:57:54.031062 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ebbb0e3-7674-4d7f-ace5-1c18047c007a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:57:54.033070 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ebbb0e3-7674-4d7f-ace5-1c18047c007a None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:57:54.090223 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:57:54.102545 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9f1abc-e392-4cf2-9b4e-ae3e3f626ffc None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:57:54.120410 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:57:54.151788 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338347df-ea40-4325-b880-bf59629dafa2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:57:54.152433 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338347df-ea40-4325-b880-bf59629dafa2 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:54.152712 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338347df-ea40-4325-b880-bf59629dafa2 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:54.152988 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338347df-ea40-4325-b880-bf59629dafa2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:54.165872 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-338347df-ea40-4325-b880-bf59629dafa2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 13 10:57:54.171179 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application [None req-338347df-ea40-4325-b880-bf59629dafa2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 13 10:57:54.171179 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 10:57:54.171179 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 10:57:54.171179 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 10:57:54.171179 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 10:57:54.171179 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 10:57:54.171179 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 10:57:54.171179 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 10:57:54.171179 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 10:57:54.171179 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 10:57:54.171179 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 10:57:54.171179 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 10:57:54.171179 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 13 10:57:54.171179 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 13 10:57:54.171179 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 13 10:57:54.171179 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 13 10:57:54.172108 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 13 10:57:54.172108 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 13 10:57:54.172108 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 13 10:57:54.172108 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 13 10:57:54.172108 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 10:57:54.172108 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 10:57:54.172108 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 10:57:54.172108 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 10:57:54.172108 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 10:57:54.172108 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 10:57:54.172108 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 10:57:54.172108 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application with Lock( Oct 13 10:57:54.172108 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 10:57:54.172108 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._enter() Oct 13 10:57:54.172108 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 10:57:54.172108 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 10:57:54.172926 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 10:57:54.172926 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.creator() Oct 13 10:57:54.172926 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 10:57:54.172926 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application created_value = creator( Oct 13 10:57:54.172926 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 13 10:57:54.172926 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 13 10:57:54.172926 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 13 10:57:54.172926 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 13 10:57:54.172926 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 13 10:57:54.172926 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 13 10:57:54.172926 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 13 10:57:54.172926 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application Oct 13 10:57:54.172926 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 161/327] 10.222.0.18 () {56 vars in 1096 bytes} [Thu Oct 13 10:57:53 2022] GET /identity/v3/roles/admin => generated 83 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 10:57:54.174249 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 167/328] 10.222.0.18 () {58 vars in 1282 bytes} [Thu Oct 13 10:57:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 403 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 13 10:57:54.178104 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338347df-ea40-4325-b880-bf59629dafa2 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:57:54.183394 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebbb0e3-7674-4d7f-ace5-1c18047c007a None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:57:54.301546 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338347df-ea40-4325-b880-bf59629dafa2 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:57:54.302509 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebbb0e3-7674-4d7f-ace5-1c18047c007a None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:57:54.343525 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e64714-4a08-4d78-bd4a-163d0be9b2a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:57:54.343525 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e64714-4a08-4d78-bd4a-163d0be9b2a8 None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:54.343947 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e64714-4a08-4d78-bd4a-163d0be9b2a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:54.344223 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e64714-4a08-4d78-bd4a-163d0be9b2a8 None admin] PATH_INFO: `/v3/projects/ab0fe3e4091a40ca831652b16957b46a` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:54.344473 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec88208-02fa-4973-80bf-33ff00b59bb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:57:54.345109 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec88208-02fa-4973-80bf-33ff00b59bb6 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:54.345384 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e64714-4a08-4d78-bd4a-163d0be9b2a8 None admin] RBAC: Authorizing `identity:get_project(project_id=ab0fe3e4091a40ca831652b16957b46a)` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:57:54.345492 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec88208-02fa-4973-80bf-33ff00b59bb6 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:54.345654 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec88208-02fa-4973-80bf-33ff00b59bb6 None admin] PATH_INFO: `/v3/roles` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:54.346318 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec88208-02fa-4973-80bf-33ff00b59bb6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 10:57:54.346616 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec88208-02fa-4973-80bf-33ff00b59bb6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:57:54.346809 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e64714-4a08-4d78-bd4a-163d0be9b2a8 None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:57:54.347958 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec88208-02fa-4973-80bf-33ff00b59bb6 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:57:54.348653 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 168/329] 10.222.0.18 () {56 vars in 1186 bytes} [Thu Oct 13 10:57:54 2022] GET /identity/v3/projects/ab0fe3e4091a40ca831652b16957b46a => generated 302 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 13 10:57:54.354511 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e64714-4a08-4d78-bd4a-163d0be9b2a8 None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:57:54.357271 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 162/330] 10.222.0.18 () {56 vars in 1099 bytes} [Thu Oct 13 10:57:54 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 10:57:54.362623 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec88208-02fa-4973-80bf-33ff00b59bb6 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:57:54.387654 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:57:54.389105 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:57:54.474753 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e64714-4a08-4d78-bd4a-163d0be9b2a8 None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:57:54.489807 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec88208-02fa-4973-80bf-33ff00b59bb6 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:57:54.509225 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0672e137-4b6f-4148-a460-110f23e856c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:57:54.509854 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0672e137-4b6f-4148-a460-110f23e856c9 None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:54.510131 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0672e137-4b6f-4148-a460-110f23e856c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:54.510396 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0672e137-4b6f-4148-a460-110f23e856c9 None admin] PATH_INFO: `/v3/groups/c0f6480dd0644b418eedd8e7fc1bff03` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:54.511482 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0672e137-4b6f-4148-a460-110f23e856c9 None admin] RBAC: Authorizing `identity:get_group(group_id=c0f6480dd0644b418eedd8e7fc1bff03)` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:57:54.512898 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0672e137-4b6f-4148-a460-110f23e856c9 None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:57:54.514478 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 169/331] 10.222.0.18 () {56 vars in 1180 bytes} [Thu Oct 13 10:57:54 2022] GET /identity/v3/groups/c0f6480dd0644b418eedd8e7fc1bff03 => generated 226 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 10:57:54.520197 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0672e137-4b6f-4148-a460-110f23e856c9 None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:57:54.523440 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653833b7-119a-4a12-959c-748d401663aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:57:54.524086 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653833b7-119a-4a12-959c-748d401663aa None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:54.524380 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653833b7-119a-4a12-959c-748d401663aa None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:54.524766 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653833b7-119a-4a12-959c-748d401663aa None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:54.592277 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653833b7-119a-4a12-959c-748d401663aa None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:57:54.593711 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653833b7-119a-4a12-959c-748d401663aa None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:57:54.606634 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:57:54.614072 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:57:54.618834 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0672e137-4b6f-4148-a460-110f23e856c9 None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:57:54.651817 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca862a75-8192-4f22-bc90-a2d4cac32ec3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:57:54.652410 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca862a75-8192-4f22-bc90-a2d4cac32ec3 None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:54.652684 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca862a75-8192-4f22-bc90-a2d4cac32ec3 None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:54.652962 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca862a75-8192-4f22-bc90-a2d4cac32ec3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:54.653705 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca862a75-8192-4f22-bc90-a2d4cac32ec3 None admin] RBAC: Adding query filter params (group.id=c0f6480dd0644b418eedd8e7fc1bff03, role.id=e49be8727cbd4a39b3fbe6925f5af415, scope.project.id=ab0fe3e4091a40ca831652b16957b46a) {{(pid=81533) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 10:57:54.654009 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca862a75-8192-4f22-bc90-a2d4cac32ec3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:57:54.655426 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca862a75-8192-4f22-bc90-a2d4cac32ec3 None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:57:54.660937 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 170/332] 10.222.0.18 () {56 vars in 1376 bytes} [Thu Oct 13 10:57:54 2022] GET /identity/v3/role_assignments?group.id=c0f6480dd0644b418eedd8e7fc1bff03&scope.project.id=ab0fe3e4091a40ca831652b16957b46a&role.id=e49be8727cbd4a39b3fbe6925f5af415 => generated 611 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 13 10:57:54.701966 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 163/333] 10.222.0.18 () {58 vars in 1282 bytes} [Thu Oct 13 10:57:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Oct 13 10:57:54.707713 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca862a75-8192-4f22-bc90-a2d4cac32ec3 None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:57:54.818054 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca862a75-8192-4f22-bc90-a2d4cac32ec3 None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:57:54.853320 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6569bb5a-900c-4786-9c56-7d9de81eaa69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:57:54.854181 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6569bb5a-900c-4786-9c56-7d9de81eaa69 None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:54.854462 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6569bb5a-900c-4786-9c56-7d9de81eaa69 None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:54.854736 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6569bb5a-900c-4786-9c56-7d9de81eaa69 None admin] PATH_INFO: `/v3/projects/9ce4ee85562d450a9dc2f16f581130d9` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:54.855867 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6569bb5a-900c-4786-9c56-7d9de81eaa69 None admin] RBAC: Authorizing `identity:get_project(project_id=9ce4ee85562d450a9dc2f16f581130d9)` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:57:54.857349 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6569bb5a-900c-4786-9c56-7d9de81eaa69 None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:57:54.859022 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 171/334] 10.222.0.18 () {56 vars in 1186 bytes} [Thu Oct 13 10:57:54 2022] GET /identity/v3/projects/9ce4ee85562d450a9dc2f16f581130d9 => generated 344 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 10:57:54.864596 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653833b7-119a-4a12-959c-748d401663aa None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:57:54.966031 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653833b7-119a-4a12-959c-748d401663aa None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:57:54.979848 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:57:55.001182 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5301be0d-96d3-4139-a2fc-c165b51561aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:57:55.001806 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5301be0d-96d3-4139-a2fc-c165b51561aa None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:55.002086 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5301be0d-96d3-4139-a2fc-c165b51561aa None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:55.002354 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5301be0d-96d3-4139-a2fc-c165b51561aa None admin] PATH_INFO: `/v3/groups/c6d7c50aba2c418c895d8edd79133c30` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:55.003453 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5301be0d-96d3-4139-a2fc-c165b51561aa None admin] RBAC: Authorizing `identity:get_group(group_id=c6d7c50aba2c418c895d8edd79133c30)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:57:55.004868 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5301be0d-96d3-4139-a2fc-c165b51561aa None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:57:55.006736 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 164/335] 10.222.0.18 () {56 vars in 1180 bytes} [Thu Oct 13 10:57:54 2022] GET /identity/v3/groups/c6d7c50aba2c418c895d8edd79133c30 => generated 229 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 10:57:55.013414 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6569bb5a-900c-4786-9c56-7d9de81eaa69 None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:57:55.044949 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:57:55.111526 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6569bb5a-900c-4786-9c56-7d9de81eaa69 None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:57:55.143825 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e513f1e1-8f00-4f54-ac64-6267121dd430 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:57:55.144405 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e513f1e1-8f00-4f54-ac64-6267121dd430 None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:55.144680 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e513f1e1-8f00-4f54-ac64-6267121dd430 None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:55.144945 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e513f1e1-8f00-4f54-ac64-6267121dd430 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:55.145683 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e513f1e1-8f00-4f54-ac64-6267121dd430 None admin] RBAC: Adding query filter params (group.id=c6d7c50aba2c418c895d8edd79133c30, role.id=30a6d59262144d4d956f4d4207864030, scope.project.id=9ce4ee85562d450a9dc2f16f581130d9) {{(pid=81533) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 10:57:55.145983 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e513f1e1-8f00-4f54-ac64-6267121dd430 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:57:55.147402 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e513f1e1-8f00-4f54-ac64-6267121dd430 None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:57:55.153118 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 172/336] 10.222.0.18 () {56 vars in 1376 bytes} [Thu Oct 13 10:57:55 2022] GET /identity/v3/role_assignments?group.id=c6d7c50aba2c418c895d8edd79133c30&scope.project.id=9ce4ee85562d450a9dc2f16f581130d9&role.id=30a6d59262144d4d956f4d4207864030 => generated 611 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 10:57:57.712354 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0241cf-0553-4736-8004-4fbd38d0b5cc None None] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:57.712354 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0241cf-0553-4736-8004-4fbd38d0b5cc None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:57.712354 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0241cf-0553-4736-8004-4fbd38d0b5cc None None] PATH_INFO: `/` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:57.712354 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 165/337] 10.222.0.18 () {54 vars in 927 bytes} [Thu Oct 13 10:57:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 10:57:57.718080 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a930ca9-4d3f-4798-94ad-dbeba5984b33 None None] REQUEST_METHOD: `POST` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:57.718918 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a930ca9-4d3f-4798-94ad-dbeba5984b33 None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:57.719398 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a930ca9-4d3f-4798-94ad-dbeba5984b33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:57.745258 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.auth.core [None req-6a930ca9-4d3f-4798-94ad-dbeba5984b33 None None] MFA Rules not processed for user `8ba31ade43694cf8bf28f7528a9ea179`. Rule list: `[]` (Enabled: `True`). {{(pid=81533) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 10:57:57.746836 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-6a930ca9-4d3f-4798-94ad-dbeba5984b33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 10:57:57.847009 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 173/338] 10.222.0.18 () {58 vars in 1024 bytes} [Thu Oct 13 10:57:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 13 10:57:57.864827 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9985141-c6d7-4b75-90dc-bcee2353d363 None None] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:57.865428 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9985141-c6d7-4b75-90dc-bcee2353d363 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:57.865917 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9985141-c6d7-4b75-90dc-bcee2353d363 None None] PATH_INFO: `/` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:57.867447 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 166/339] 10.222.0.18 () {54 vars in 927 bytes} [Thu Oct 13 10:57:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 10:57:57.873475 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753a9a39-be53-4850-b6f0-251fae66cba0 None None] REQUEST_METHOD: `POST` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:57.873764 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753a9a39-be53-4850-b6f0-251fae66cba0 None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:57.874047 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753a9a39-be53-4850-b6f0-251fae66cba0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:57.902953 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.auth.core [None req-753a9a39-be53-4850-b6f0-251fae66cba0 None None] MFA Rules not processed for user `8ba31ade43694cf8bf28f7528a9ea179`. Rule list: `[]` (Enabled: `True`). {{(pid=81533) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 10:57:57.904139 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-753a9a39-be53-4850-b6f0-251fae66cba0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 10:57:57.929644 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:57:57.987269 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 174/340] 10.222.0.18 () {58 vars in 1024 bytes} [Thu Oct 13 10:57:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 13 10:57:58.187209 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b5bb3f-d66e-42ba-b902-65897a97d94e None None] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:58.187591 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b5bb3f-d66e-42ba-b902-65897a97d94e None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:58.187774 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b5bb3f-d66e-42ba-b902-65897a97d94e None None] PATH_INFO: `/` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:58.189384 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 167/341] 10.222.0.18 () {54 vars in 927 bytes} [Thu Oct 13 10:57:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 10:57:58.194289 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4fbde2-0da9-4c1a-b75e-1ef0b16cb8f1 None None] REQUEST_METHOD: `POST` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:58.194579 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4fbde2-0da9-4c1a-b75e-1ef0b16cb8f1 None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:58.194864 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4fbde2-0da9-4c1a-b75e-1ef0b16cb8f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:58.217945 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.auth.core [None req-9a4fbde2-0da9-4c1a-b75e-1ef0b16cb8f1 None None] MFA Rules not processed for user `8ba31ade43694cf8bf28f7528a9ea179`. Rule list: `[]` (Enabled: `True`). {{(pid=81533) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 10:57:58.219108 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-9a4fbde2-0da9-4c1a-b75e-1ef0b16cb8f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 10:57:58.290982 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 175/342] 10.222.0.18 () {58 vars in 1024 bytes} [Thu Oct 13 10:57:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 13 10:57:58.293798 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b5bb3f-d66e-42ba-b902-65897a97d94e None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:57:58.295973 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4fbde2-0da9-4c1a-b75e-1ef0b16cb8f1 None None] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:57:58.418679 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:57:58.450314 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4fbde2-0da9-4c1a-b75e-1ef0b16cb8f1 None None] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:57:58.504393 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b5bb3f-d66e-42ba-b902-65897a97d94e None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:57:58.504913 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad78b43-46e2-41f4-8dfd-78d266a6cab4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:57:58.505822 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad78b43-46e2-41f4-8dfd-78d266a6cab4 None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:58.506306 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad78b43-46e2-41f4-8dfd-78d266a6cab4 None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:58.507031 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad78b43-46e2-41f4-8dfd-78d266a6cab4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:58.517963 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad78b43-46e2-41f4-8dfd-78d266a6cab4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:57:58.519729 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad78b43-46e2-41f4-8dfd-78d266a6cab4 None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:57:58.537290 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application [None req-0ad78b43-46e2-41f4-8dfd-78d266a6cab4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 13 10:57:58.537290 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 10:57:58.537290 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 10:57:58.537290 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 10:57:58.537290 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 10:57:58.537290 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 10:57:58.537290 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 10:57:58.537290 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 10:57:58.537290 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 10:57:58.537290 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 10:57:58.537290 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 10:57:58.537290 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 10:57:58.537290 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 13 10:57:58.537290 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 13 10:57:58.537290 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 13 10:57:58.537290 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 13 10:57:58.538306 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 10:57:58.538306 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 10:57:58.538306 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 10:57:58.538306 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 10:57:58.538306 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 10:57:58.538306 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 10:57:58.538306 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 10:57:58.538306 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application with Lock( Oct 13 10:57:58.538306 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 10:57:58.538306 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._enter() Oct 13 10:57:58.538306 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 10:57:58.538306 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 10:57:58.538306 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 10:57:58.538306 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.creator() Oct 13 10:57:58.538306 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 10:57:58.538306 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application created_value = creator( Oct 13 10:57:58.538306 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 13 10:57:58.539227 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 13 10:57:58.539227 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 13 10:57:58.539227 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application Oct 13 10:57:58.541594 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 176/343] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Oct 13 10:57:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 13 10:57:58.550092 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad78b43-46e2-41f4-8dfd-78d266a6cab4 None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:57:58.574485 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0f9f3e-8600-4b41-9b7d-fee0dd7abf8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:57:58.575733 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0f9f3e-8600-4b41-9b7d-fee0dd7abf8c None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:58.577564 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0f9f3e-8600-4b41-9b7d-fee0dd7abf8c None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:58.578058 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0f9f3e-8600-4b41-9b7d-fee0dd7abf8c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:58.601582 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0f9f3e-8600-4b41-9b7d-fee0dd7abf8c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:57:58.604407 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0f9f3e-8600-4b41-9b7d-fee0dd7abf8c None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:57:58.630389 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application [None req-1f0f9f3e-8600-4b41-9b7d-fee0dd7abf8c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 13 10:57:58.630389 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 10:57:58.630389 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 10:57:58.630389 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 10:57:58.630389 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 10:57:58.630389 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 10:57:58.630389 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 10:57:58.630389 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 10:57:58.630389 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 10:57:58.630389 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 10:57:58.630389 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 10:57:58.630389 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 10:57:58.630389 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 13 10:57:58.630389 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 13 10:57:58.630389 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 13 10:57:58.630389 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 13 10:57:58.631631 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 10:57:58.631631 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 10:57:58.631631 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 10:57:58.631631 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 10:57:58.631631 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 10:57:58.631631 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 10:57:58.631631 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 10:57:58.631631 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application with Lock( Oct 13 10:57:58.631631 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 10:57:58.631631 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._enter() Oct 13 10:57:58.631631 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 10:57:58.631631 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 10:57:58.631631 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 10:57:58.631631 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.creator() Oct 13 10:57:58.631631 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 10:57:58.631631 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application created_value = creator( Oct 13 10:57:58.631631 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 13 10:57:58.632510 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 13 10:57:58.632510 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 13 10:57:58.632510 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application Oct 13 10:57:58.634744 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 168/344] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Oct 13 10:57:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 341 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 13 10:57:58.635453 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0f9f3e-8600-4b41-9b7d-fee0dd7abf8c None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:57:58.675345 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:57:58.721000 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad78b43-46e2-41f4-8dfd-78d266a6cab4 None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:57:58.759907 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0f9f3e-8600-4b41-9b7d-fee0dd7abf8c None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:57:58.770876 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85032a04-8cee-4530-9f5d-0ded8817d7a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:57:58.771489 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85032a04-8cee-4530-9f5d-0ded8817d7a5 None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:58.771771 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85032a04-8cee-4530-9f5d-0ded8817d7a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:58.772045 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85032a04-8cee-4530-9f5d-0ded8817d7a5 None admin] PATH_INFO: `/v3/domains` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:58.772686 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85032a04-8cee-4530-9f5d-0ded8817d7a5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81533) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 10:57:58.773117 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85032a04-8cee-4530-9f5d-0ded8817d7a5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:57:58.774647 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85032a04-8cee-4530-9f5d-0ded8817d7a5 None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:57:58.777226 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:57:58.787945 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 177/345] 10.222.0.18 () {56 vars in 1109 bytes} [Thu Oct 13 10:57:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 13 10:57:58.788799 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85032a04-8cee-4530-9f5d-0ded8817d7a5 None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:57:58.802484 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab95d058-21b0-4540-85c5-d9478162227d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:57:58.803367 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab95d058-21b0-4540-85c5-d9478162227d None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:58.803822 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab95d058-21b0-4540-85c5-d9478162227d None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:58.804291 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab95d058-21b0-4540-85c5-d9478162227d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:58.817573 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab95d058-21b0-4540-85c5-d9478162227d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:57:58.819449 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab95d058-21b0-4540-85c5-d9478162227d None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:57:58.838571 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application [None req-ab95d058-21b0-4540-85c5-d9478162227d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 13 10:57:58.838571 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 10:57:58.838571 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 10:57:58.838571 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 10:57:58.838571 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 10:57:58.838571 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 10:57:58.838571 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 10:57:58.838571 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 10:57:58.838571 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 10:57:58.838571 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 10:57:58.838571 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 10:57:58.838571 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 10:57:58.838571 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 13 10:57:58.838571 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 13 10:57:58.838571 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 13 10:57:58.838571 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 13 10:57:58.839521 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 10:57:58.839521 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 10:57:58.839521 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 10:57:58.839521 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 10:57:58.839521 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 10:57:58.839521 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 10:57:58.839521 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 10:57:58.839521 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application with Lock( Oct 13 10:57:58.839521 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 10:57:58.839521 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._enter() Oct 13 10:57:58.839521 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 10:57:58.839521 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 10:57:58.839521 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 10:57:58.839521 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.creator() Oct 13 10:57:58.839521 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 10:57:58.839521 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application created_value = creator( Oct 13 10:57:58.839521 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 13 10:57:58.840370 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 13 10:57:58.840370 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 13 10:57:58.840370 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application Oct 13 10:57:58.840370 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 169/346] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Oct 13 10:57:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 10:57:58.842273 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c32a14-3861-4d9a-a4fa-f2a062bc942d None None] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:58.842559 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c32a14-3861-4d9a-a4fa-f2a062bc942d None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:58.842832 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c32a14-3861-4d9a-a4fa-f2a062bc942d None None] PATH_INFO: `/` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:58.844209 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 170/347] 10.222.0.18 () {54 vars in 927 bytes} [Thu Oct 13 10:57:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 10:57:58.844764 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c32a14-3861-4d9a-a4fa-f2a062bc942d None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:57:58.894157 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85032a04-8cee-4530-9f5d-0ded8817d7a5 None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:57:58.929016 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a7805a-8fa1-4a3d-aee7-a6b2199213a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:57:58.929622 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a7805a-8fa1-4a3d-aee7-a6b2199213a6 None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:58.929904 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a7805a-8fa1-4a3d-aee7-a6b2199213a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:58.930202 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a7805a-8fa1-4a3d-aee7-a6b2199213a6 None admin] PATH_INFO: `/v3/domains` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:58.931005 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a7805a-8fa1-4a3d-aee7-a6b2199213a6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81533) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 10:57:58.931325 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a7805a-8fa1-4a3d-aee7-a6b2199213a6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:57:58.932705 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a7805a-8fa1-4a3d-aee7-a6b2199213a6 None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:57:58.938105 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:57:58.944518 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 178/348] 10.222.0.18 () {56 vars in 1109 bytes} [Thu Oct 13 10:57:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 10:57:58.945360 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a7805a-8fa1-4a3d-aee7-a6b2199213a6 None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:57:58.959499 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c32a14-3861-4d9a-a4fa-f2a062bc942d None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:57:58.999377 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952bb56c-f0c0-4672-a2fb-a1bdce92fc95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:57:59.000034 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952bb56c-f0c0-4672-a2fb-a1bdce92fc95 None admin] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:59.000316 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952bb56c-f0c0-4672-a2fb-a1bdce92fc95 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:59.000586 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952bb56c-f0c0-4672-a2fb-a1bdce92fc95 None admin] PATH_INFO: `/v3/users` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:59.001261 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952bb56c-f0c0-4672-a2fb-a1bdce92fc95 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:57:59.002822 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952bb56c-f0c0-4672-a2fb-a1bdce92fc95 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:57:59.005465 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:57:59.037046 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 171/349] 10.222.0.18 () {60 vars in 1132 bytes} [Thu Oct 13 10:57:58 2022] POST /identity/v3/users => generated 246 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 13 10:57:59.037046 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7048e9-6ada-4d90-be32-932f8d26e531 None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:59.037046 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7048e9-6ada-4d90-be32-932f8d26e531 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:59.037046 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7048e9-6ada-4d90-be32-932f8d26e531 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:59.061496 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-2a7048e9-6ada-4d90-be32-932f8d26e531 None None] MFA Rules not processed for user `8ba31ade43694cf8bf28f7528a9ea179`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 10:57:59.062781 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-2a7048e9-6ada-4d90-be32-932f8d26e531 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 10:57:59.062913 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a7805a-8fa1-4a3d-aee7-a6b2199213a6 None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:57:59.104605 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5610ad69-929c-483b-924e-1a38b33f47f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:57:59.105412 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5610ad69-929c-483b-924e-1a38b33f47f5 None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:59.105764 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5610ad69-929c-483b-924e-1a38b33f47f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:59.106033 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5610ad69-929c-483b-924e-1a38b33f47f5 None admin] PATH_INFO: `/v3/domains` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:59.106691 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5610ad69-929c-483b-924e-1a38b33f47f5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81533) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 10:57:59.107159 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5610ad69-929c-483b-924e-1a38b33f47f5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:57:59.108568 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5610ad69-929c-483b-924e-1a38b33f47f5 None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:57:59.123292 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 179/350] 10.222.0.18 () {56 vars in 1109 bytes} [Thu Oct 13 10:57:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 10:57:59.129183 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5610ad69-929c-483b-924e-1a38b33f47f5 None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:57:59.154846 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 172/351] 10.222.0.18 () {58 vars in 1024 bytes} [Thu Oct 13 10:57:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 13 10:57:59.155971 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7048e9-6ada-4d90-be32-932f8d26e531 None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:57:59.287172 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5610ad69-929c-483b-924e-1a38b33f47f5 None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:57:59.289380 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:57:59.306058 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:57:59.314663 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7048e9-6ada-4d90-be32-932f8d26e531 None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:57:59.329972 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82892e4c-e73d-45f8-8613-27b1be3518ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:57:59.330828 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82892e4c-e73d-45f8-8613-27b1be3518ae None admin] REQUEST_METHOD: `POST` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:59.331264 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82892e4c-e73d-45f8-8613-27b1be3518ae None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:59.331729 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82892e4c-e73d-45f8-8613-27b1be3518ae None admin] PATH_INFO: `/v3/users` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:59.332523 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82892e4c-e73d-45f8-8613-27b1be3518ae None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:57:59.334225 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82892e4c-e73d-45f8-8613-27b1be3518ae None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:57:59.360119 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82c33be-c770-459e-acb9-999a1fe8eb1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:57:59.360776 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82c33be-c770-459e-acb9-999a1fe8eb1a None admin] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:59.361090 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82c33be-c770-459e-acb9-999a1fe8eb1a None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:59.361372 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82c33be-c770-459e-acb9-999a1fe8eb1a None admin] PATH_INFO: `/v3/users` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:59.362016 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82c33be-c770-459e-acb9-999a1fe8eb1a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:57:59.363501 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82c33be-c770-459e-acb9-999a1fe8eb1a None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:57:59.364885 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 180/352] 10.222.0.18 () {60 vars in 1132 bytes} [Thu Oct 13 10:57:59 2022] POST /identity/v3/users => generated 248 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 13 10:57:59.410856 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 173/353] 10.222.0.18 () {60 vars in 1132 bytes} [Thu Oct 13 10:57:59 2022] POST /identity/v3/users => generated 248 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 13 10:57:59.452430 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82892e4c-e73d-45f8-8613-27b1be3518ae None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:57:59.580640 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4292355d-e696-48b3-aab0-d738635b7fb5 None None] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:59.580832 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4292355d-e696-48b3-aab0-d738635b7fb5 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:59.581157 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4292355d-e696-48b3-aab0-d738635b7fb5 None None] PATH_INFO: `/` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:59.582541 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 174/354] 10.222.0.18 () {54 vars in 927 bytes} [Thu Oct 13 10:57:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 13 10:57:59.588679 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc7ffd5-a9ce-4be2-8c57-5017378cd6f5 None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:59.588980 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc7ffd5-a9ce-4be2-8c57-5017378cd6f5 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:59.589257 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc7ffd5-a9ce-4be2-8c57-5017378cd6f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:59.591834 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82892e4c-e73d-45f8-8613-27b1be3518ae None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:57:59.619581 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-4cc7ffd5-a9ce-4be2-8c57-5017378cd6f5 None None] MFA Rules not processed for user `8ba31ade43694cf8bf28f7528a9ea179`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 10:57:59.620816 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-4cc7ffd5-a9ce-4be2-8c57-5017378cd6f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 10:57:59.653245 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c58fd1-4baf-4cb3-817e-29a0c6ffde6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:57:59.654562 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c58fd1-4baf-4cb3-817e-29a0c6ffde6a None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:59.655625 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c58fd1-4baf-4cb3-817e-29a0c6ffde6a None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:59.656543 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c58fd1-4baf-4cb3-817e-29a0c6ffde6a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:59.672303 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c58fd1-4baf-4cb3-817e-29a0c6ffde6a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:57:59.674601 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c58fd1-4baf-4cb3-817e-29a0c6ffde6a None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:57:59.695123 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application [None req-29c58fd1-4baf-4cb3-817e-29a0c6ffde6a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 13 10:57:59.695123 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 10:57:59.695123 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 10:57:59.695123 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 10:57:59.695123 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 10:57:59.695123 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 10:57:59.695123 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 10:57:59.695123 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 10:57:59.695123 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 10:57:59.695123 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 10:57:59.695123 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 10:57:59.695123 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 10:57:59.695123 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 13 10:57:59.695123 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 13 10:57:59.695123 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 13 10:57:59.695123 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 13 10:57:59.696618 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 10:57:59.696618 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 10:57:59.696618 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 10:57:59.696618 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 10:57:59.696618 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 10:57:59.696618 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 10:57:59.696618 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 10:57:59.696618 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application with Lock( Oct 13 10:57:59.696618 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 10:57:59.696618 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._enter() Oct 13 10:57:59.696618 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 10:57:59.696618 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 10:57:59.696618 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 10:57:59.696618 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.creator() Oct 13 10:57:59.696618 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 10:57:59.696618 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application created_value = creator( Oct 13 10:57:59.696618 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 13 10:57:59.697694 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 13 10:57:59.697694 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 13 10:57:59.697694 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application Oct 13 10:57:59.697694 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 181/355] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Oct 13 10:57:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 10:57:59.704784 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c58fd1-4baf-4cb3-817e-29a0c6ffde6a None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:57:59.720323 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 175/356] 10.222.0.18 () {58 vars in 1024 bytes} [Thu Oct 13 10:57:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 13 10:57:59.736559 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:57:59.826559 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c58fd1-4baf-4cb3-817e-29a0c6ffde6a None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:57:59.875274 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329348de-1ffd-41df-a1f3-83e5c88e54c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:57:59.876146 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329348de-1ffd-41df-a1f3-83e5c88e54c7 None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:57:59.876571 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329348de-1ffd-41df-a1f3-83e5c88e54c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:57:59.876990 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329348de-1ffd-41df-a1f3-83e5c88e54c7 None admin] PATH_INFO: `/v3/domains` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:57:59.877814 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329348de-1ffd-41df-a1f3-83e5c88e54c7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81533) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 10:57:59.878264 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329348de-1ffd-41df-a1f3-83e5c88e54c7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:57:59.879785 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329348de-1ffd-41df-a1f3-83e5c88e54c7 None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:57:59.896281 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 182/357] 10.222.0.18 () {56 vars in 1109 bytes} [Thu Oct 13 10:57:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 10:57:59.902903 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc7ffd5-a9ce-4be2-8c57-5017378cd6f5 None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:57:59.983514 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:58:00.040832 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc7ffd5-a9ce-4be2-8c57-5017378cd6f5 None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:00.043430 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329348de-1ffd-41df-a1f3-83e5c88e54c7 None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:00.080306 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48569e3-8db4-493e-b552-7bd56e4e03ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:00.081217 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48569e3-8db4-493e-b552-7bd56e4e03ce None admin] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:00.085030 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48569e3-8db4-493e-b552-7bd56e4e03ce None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:00.085030 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48569e3-8db4-493e-b552-7bd56e4e03ce None admin] PATH_INFO: `/v3/users` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:00.085030 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48569e3-8db4-493e-b552-7bd56e4e03ce None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:00.085030 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48569e3-8db4-493e-b552-7bd56e4e03ce None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:00.112389 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 176/358] 10.222.0.18 () {60 vars in 1132 bytes} [Thu Oct 13 10:57:59 2022] POST /identity/v3/users => generated 249 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 13 10:58:00.207634 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:58:00.237555 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329348de-1ffd-41df-a1f3-83e5c88e54c7 None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:00.286758 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d417dd06-b2ed-4e08-8a01-001b4816e879 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:00.287777 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d417dd06-b2ed-4e08-8a01-001b4816e879 None admin] REQUEST_METHOD: `POST` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:00.288305 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d417dd06-b2ed-4e08-8a01-001b4816e879 None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:00.288779 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d417dd06-b2ed-4e08-8a01-001b4816e879 None admin] PATH_INFO: `/v3/roles` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:00.290276 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d417dd06-b2ed-4e08-8a01-001b4816e879 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:00.291981 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d417dd06-b2ed-4e08-8a01-001b4816e879 None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:00.301968 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.sql.core [None req-d417dd06-b2ed-4e08-8a01-001b4816e879 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Oct 13 10:58:00.301968 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Oct 13 10:58:00.301968 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: [parameters: {'id': '54f3edfcd52a44da94588ec612d0fb6f', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Oct 13 10:58:00.301968 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81533) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Oct 13 10:58:00.320112 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application [None req-d417dd06-b2ed-4e08-8a01-001b4816e879 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Oct 13 10:58:00.320112 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 10:58:00.320112 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 13 10:58:00.320112 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 13 10:58:00.320112 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 13 10:58:00.320112 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 13 10:58:00.320112 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 13 10:58:00.320112 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application result = self._query(query) Oct 13 10:58:00.320112 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 13 10:58:00.320112 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application conn.query(q) Oct 13 10:58:00.320112 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 13 10:58:00.320112 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 13 10:58:00.320112 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 13 10:58:00.320112 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application result.read() Oct 13 10:58:00.320112 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 13 10:58:00.321672 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 13 10:58:00.321672 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 13 10:58:00.321672 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 13 10:58:00.321672 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 13 10:58:00.321672 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 13 10:58:00.321672 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 13 10:58:00.321672 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 13 10:58:00.321672 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Oct 13 10:58:00.321672 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application Oct 13 10:58:00.321672 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Oct 13 10:58:00.321672 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application Oct 13 10:58:00.321672 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 10:58:00.321672 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Oct 13 10:58:00.321672 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return method(*args, **kwargs) Oct 13 10:58:00.321672 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Oct 13 10:58:00.321672 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return ref.to_dict() Oct 13 10:58:00.321672 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 13 10:58:00.321672 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application next(self.gen) Oct 13 10:58:00.322612 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Oct 13 10:58:00.322612 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application yield resource Oct 13 10:58:00.322612 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 13 10:58:00.322612 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application next(self.gen) Oct 13 10:58:00.322612 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Oct 13 10:58:00.322612 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application self.session.rollback() Oct 13 10:58:00.322612 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 13 10:58:00.322612 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application self.force_reraise() Oct 13 10:58:00.322612 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 13 10:58:00.322612 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application raise self.value Oct 13 10:58:00.322612 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Oct 13 10:58:00.322612 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Oct 13 10:58:00.322612 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Oct 13 10:58:00.322612 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application session.commit() Oct 13 10:58:00.322612 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Oct 13 10:58:00.322612 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Oct 13 10:58:00.322612 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Oct 13 10:58:00.324073 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application self._prepare_impl() Oct 13 10:58:00.324073 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Oct 13 10:58:00.324073 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application self.session.flush() Oct 13 10:58:00.324073 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 13 10:58:00.324073 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application self._flush(objects) Oct 13 10:58:00.324073 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 13 10:58:00.324073 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Oct 13 10:58:00.324073 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 13 10:58:00.324073 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application compat.raise_( Oct 13 10:58:00.324073 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 13 10:58:00.324073 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application raise exception Oct 13 10:58:00.324073 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 13 10:58:00.324073 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application flush_context.execute() Oct 13 10:58:00.324073 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 13 10:58:00.324073 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application rec.execute(self) Oct 13 10:58:00.324073 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 13 10:58:00.324073 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Oct 13 10:58:00.324985 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 13 10:58:00.324985 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application _emit_insert_statements( Oct 13 10:58:00.324985 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Oct 13 10:58:00.324985 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application c = connection._execute_20( Oct 13 10:58:00.324985 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 13 10:58:00.324985 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Oct 13 10:58:00.324985 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 13 10:58:00.324985 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Oct 13 10:58:00.324985 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 13 10:58:00.324985 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application ret = self._execute_context( Oct 13 10:58:00.324985 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 13 10:58:00.324985 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Oct 13 10:58:00.324985 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 13 10:58:00.324985 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 13 10:58:00.324985 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 13 10:58:00.324985 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application raise exception Oct 13 10:58:00.325885 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 13 10:58:00.325885 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 13 10:58:00.325885 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 13 10:58:00.325885 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 13 10:58:00.325885 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 13 10:58:00.325885 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application result = self._query(query) Oct 13 10:58:00.325885 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 13 10:58:00.325885 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application conn.query(q) Oct 13 10:58:00.325885 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 13 10:58:00.325885 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 13 10:58:00.325885 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 13 10:58:00.325885 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application result.read() Oct 13 10:58:00.325885 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 13 10:58:00.325885 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 13 10:58:00.325885 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 13 10:58:00.325885 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 13 10:58:00.326692 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 13 10:58:00.326692 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 13 10:58:00.326692 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 13 10:58:00.326692 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 13 10:58:00.326692 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Oct 13 10:58:00.326692 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Oct 13 10:58:00.326692 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application [parameters: {'id': '54f3edfcd52a44da94588ec612d0fb6f', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Oct 13 10:58:00.326692 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 13 10:58:00.326692 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application Oct 13 10:58:00.326692 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 13 10:58:00.326692 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application Oct 13 10:58:00.326692 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 10:58:00.326692 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 10:58:00.326692 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 10:58:00.326692 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 10:58:00.326692 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 10:58:00.328712 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 10:58:00.328712 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 10:58:00.328712 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 10:58:00.328712 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 10:58:00.328712 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 10:58:00.328712 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 10:58:00.328712 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Oct 13 10:58:00.328712 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Oct 13 10:58:00.328712 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 10:58:00.328712 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 10:58:00.328712 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Oct 13 10:58:00.328712 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Oct 13 10:58:00.328712 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Oct 13 10:58:00.328712 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Oct 13 10:58:00.328712 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Oct 13 10:58:00.328712 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application Oct 13 10:58:00.332459 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 183/359] 10.222.0.18 () {60 vars in 1131 bytes} [Thu Oct 13 10:58:00 2022] POST /identity/v3/roles => generated 144 bytes in 289 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Oct 13 10:58:00.339477 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48569e3-8db4-493e-b552-7bd56e4e03ce None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:00.464993 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48569e3-8db4-493e-b552-7bd56e4e03ce None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:00.481371 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:58:00.511792 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ae0372-8ea4-46f4-99d4-e4d54aa1e6c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:00.512589 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ae0372-8ea4-46f4-99d4-e4d54aa1e6c8 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:00.513019 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ae0372-8ea4-46f4-99d4-e4d54aa1e6c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:00.513399 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ae0372-8ea4-46f4-99d4-e4d54aa1e6c8 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:00.524190 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ae0372-8ea4-46f4-99d4-e4d54aa1e6c8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 13 10:58:00.537984 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application [None req-24ae0372-8ea4-46f4-99d4-e4d54aa1e6c8 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 13 10:58:00.537984 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 10:58:00.537984 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 10:58:00.537984 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 10:58:00.537984 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 10:58:00.537984 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 10:58:00.537984 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 10:58:00.537984 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 10:58:00.537984 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 10:58:00.537984 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 10:58:00.537984 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 10:58:00.537984 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 10:58:00.537984 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 13 10:58:00.537984 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 13 10:58:00.537984 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 13 10:58:00.537984 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 13 10:58:00.539094 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 13 10:58:00.539094 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 13 10:58:00.539094 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 13 10:58:00.539094 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 13 10:58:00.539094 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 10:58:00.539094 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 10:58:00.539094 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 10:58:00.539094 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 10:58:00.539094 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 10:58:00.539094 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 10:58:00.539094 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 10:58:00.539094 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application with Lock( Oct 13 10:58:00.539094 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 10:58:00.539094 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._enter() Oct 13 10:58:00.539094 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 10:58:00.539094 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 10:58:00.540652 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 10:58:00.540652 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.creator() Oct 13 10:58:00.540652 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 10:58:00.540652 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application created_value = creator( Oct 13 10:58:00.540652 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 13 10:58:00.540652 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 13 10:58:00.540652 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 13 10:58:00.540652 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 13 10:58:00.540652 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 13 10:58:00.540652 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 13 10:58:00.540652 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 13 10:58:00.540652 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application Oct 13 10:58:00.545027 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 177/360] 10.222.0.18 () {56 vars in 1114 bytes} [Thu Oct 13 10:58:00 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 10:58:00.548223 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d417dd06-b2ed-4e08-8a01-001b4816e879 None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:00.656690 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d417dd06-b2ed-4e08-8a01-001b4816e879 None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:00.693297 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4daa0808-b17d-4a6b-955b-2099265612e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:00.694069 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4daa0808-b17d-4a6b-955b-2099265612e3 None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:00.694447 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4daa0808-b17d-4a6b-955b-2099265612e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:00.694817 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4daa0808-b17d-4a6b-955b-2099265612e3 None admin] PATH_INFO: `/v3/roles` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:00.695598 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4daa0808-b17d-4a6b-955b-2099265612e3 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81533) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 10:58:00.696092 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4daa0808-b17d-4a6b-955b-2099265612e3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:00.697593 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4daa0808-b17d-4a6b-955b-2099265612e3 None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:00.706715 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 184/361] 10.222.0.18 () {56 vars in 1111 bytes} [Thu Oct 13 10:58:00 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 10:58:01.838803 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a755fef2-8743-4477-9498-2f756ccc4ddd None None] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:01.839313 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a755fef2-8743-4477-9498-2f756ccc4ddd None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:01.839419 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a755fef2-8743-4477-9498-2f756ccc4ddd None None] PATH_INFO: `/` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:01.840703 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 178/362] 10.222.0.18 () {54 vars in 927 bytes} [Thu Oct 13 10:58:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 13 10:58:01.846185 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99aec00-92af-4381-bda0-384588b361c2 None None] REQUEST_METHOD: `POST` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:01.846643 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99aec00-92af-4381-bda0-384588b361c2 None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:01.846720 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99aec00-92af-4381-bda0-384588b361c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:01.870326 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.auth.core [None req-a99aec00-92af-4381-bda0-384588b361c2 None None] MFA Rules not processed for user `8ba31ade43694cf8bf28f7528a9ea179`. Rule list: `[]` (Enabled: `True`). {{(pid=81533) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 10:58:01.871526 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-a99aec00-92af-4381-bda0-384588b361c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 10:58:01.874537 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:58:01.967494 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 185/363] 10.222.0.18 () {58 vars in 1024 bytes} [Thu Oct 13 10:58:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 13 10:58:02.088362 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a24bea-feaf-48d8-a336-a1f7c1963174 None None] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:02.088652 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a24bea-feaf-48d8-a336-a1f7c1963174 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:02.088833 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a24bea-feaf-48d8-a336-a1f7c1963174 None None] PATH_INFO: `/` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:02.090525 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 179/364] 10.222.0.18 () {54 vars in 927 bytes} [Thu Oct 13 10:58:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 10:58:02.095414 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2830e4cb-ebf8-4158-9b48-3fff2f25a6c4 None None] REQUEST_METHOD: `POST` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:02.095923 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2830e4cb-ebf8-4158-9b48-3fff2f25a6c4 None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:02.096413 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2830e4cb-ebf8-4158-9b48-3fff2f25a6c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:02.122064 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.auth.core [None req-2830e4cb-ebf8-4158-9b48-3fff2f25a6c4 None None] MFA Rules not processed for user `8ba31ade43694cf8bf28f7528a9ea179`. Rule list: `[]` (Enabled: `True`). {{(pid=81533) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 10:58:02.123259 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-2830e4cb-ebf8-4158-9b48-3fff2f25a6c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 10:58:02.209327 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 186/365] 10.222.0.18 () {58 vars in 1024 bytes} [Thu Oct 13 10:58:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 13 10:58:02.390110 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a633dba6-49e2-420e-9f22-94f3f928f73e None None] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:02.390755 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a633dba6-49e2-420e-9f22-94f3f928f73e None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:02.391246 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a633dba6-49e2-420e-9f22-94f3f928f73e None None] PATH_INFO: `/` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:02.393037 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 180/366] 10.222.0.18 () {54 vars in 927 bytes} [Thu Oct 13 10:58:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 10:58:02.398472 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44149d34-441e-4b56-aa30-1215b882af1a None None] REQUEST_METHOD: `POST` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:02.399489 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44149d34-441e-4b56-aa30-1215b882af1a None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:02.399963 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44149d34-441e-4b56-aa30-1215b882af1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:02.423795 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a633dba6-49e2-420e-9f22-94f3f928f73e None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:02.426122 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.auth.core [None req-44149d34-441e-4b56-aa30-1215b882af1a None None] MFA Rules not processed for user `8ba31ade43694cf8bf28f7528a9ea179`. Rule list: `[]` (Enabled: `True`). {{(pid=81533) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 10:58:02.427781 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-44149d34-441e-4b56-aa30-1215b882af1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 10:58:02.517042 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 187/367] 10.222.0.18 () {58 vars in 1024 bytes} [Thu Oct 13 10:58:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 13 10:58:02.517042 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:58:02.581339 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44149d34-441e-4b56-aa30-1215b882af1a None None] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:02.583719 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a633dba6-49e2-420e-9f22-94f3f928f73e None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:02.626005 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1558ad61-0e62-4a6c-971d-21a500383b84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:02.626626 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1558ad61-0e62-4a6c-971d-21a500383b84 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:02.626899 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1558ad61-0e62-4a6c-971d-21a500383b84 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:02.627165 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1558ad61-0e62-4a6c-971d-21a500383b84 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:02.647434 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1558ad61-0e62-4a6c-971d-21a500383b84 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 13 10:58:02.652830 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application [None req-1558ad61-0e62-4a6c-971d-21a500383b84 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 13 10:58:02.652830 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 10:58:02.652830 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 10:58:02.652830 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 10:58:02.652830 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 10:58:02.652830 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 10:58:02.652830 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 10:58:02.652830 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 10:58:02.652830 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 10:58:02.652830 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 10:58:02.652830 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 10:58:02.652830 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 10:58:02.652830 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 13 10:58:02.652830 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 13 10:58:02.652830 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 13 10:58:02.652830 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 13 10:58:02.653745 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 13 10:58:02.653745 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 13 10:58:02.653745 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 13 10:58:02.653745 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 13 10:58:02.653745 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 10:58:02.653745 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 10:58:02.653745 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 10:58:02.653745 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 10:58:02.653745 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 10:58:02.653745 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 10:58:02.653745 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 10:58:02.653745 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application with Lock( Oct 13 10:58:02.653745 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 10:58:02.653745 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._enter() Oct 13 10:58:02.653745 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 10:58:02.653745 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 10:58:02.654584 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 10:58:02.654584 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.creator() Oct 13 10:58:02.654584 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 10:58:02.654584 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application created_value = creator( Oct 13 10:58:02.654584 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 13 10:58:02.654584 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 13 10:58:02.654584 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 13 10:58:02.654584 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 13 10:58:02.654584 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 13 10:58:02.654584 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 13 10:58:02.654584 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 13 10:58:02.654584 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application Oct 13 10:58:02.654584 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 181/368] 10.222.0.18 () {56 vars in 1102 bytes} [Thu Oct 13 10:58:02 2022] GET /identity/v3/roles/service => generated 85 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 10:58:02.659831 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1558ad61-0e62-4a6c-971d-21a500383b84 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:02.721410 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:58:02.764280 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44149d34-441e-4b56-aa30-1215b882af1a None None] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:02.806131 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961ae2f5-04eb-4969-8d00-46f7d97693a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:02.806834 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961ae2f5-04eb-4969-8d00-46f7d97693a3 None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:02.807111 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961ae2f5-04eb-4969-8d00-46f7d97693a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:02.807434 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961ae2f5-04eb-4969-8d00-46f7d97693a3 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:02.831830 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961ae2f5-04eb-4969-8d00-46f7d97693a3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 13 10:58:02.837675 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application [None req-961ae2f5-04eb-4969-8d00-46f7d97693a3 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 13 10:58:02.837675 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 10:58:02.837675 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 10:58:02.837675 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 10:58:02.837675 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 10:58:02.837675 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 10:58:02.837675 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 10:58:02.837675 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 10:58:02.837675 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 10:58:02.837675 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 10:58:02.837675 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 10:58:02.837675 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 10:58:02.837675 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 13 10:58:02.837675 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 13 10:58:02.837675 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 13 10:58:02.837675 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 13 10:58:02.838580 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 13 10:58:02.838580 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 13 10:58:02.838580 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 13 10:58:02.838580 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 13 10:58:02.838580 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 10:58:02.838580 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 10:58:02.838580 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 10:58:02.838580 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 10:58:02.838580 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 10:58:02.838580 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 10:58:02.838580 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 10:58:02.838580 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application with Lock( Oct 13 10:58:02.838580 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 10:58:02.838580 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._enter() Oct 13 10:58:02.838580 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 10:58:02.838580 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 10:58:02.839394 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 10:58:02.839394 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.creator() Oct 13 10:58:02.839394 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 10:58:02.839394 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application created_value = creator( Oct 13 10:58:02.839394 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 13 10:58:02.839394 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 13 10:58:02.839394 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 13 10:58:02.839394 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 13 10:58:02.839394 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 13 10:58:02.839394 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 13 10:58:02.839394 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 13 10:58:02.839394 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application Oct 13 10:58:02.839394 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 188/369] 10.222.0.18 () {56 vars in 1102 bytes} [Thu Oct 13 10:58:02 2022] GET /identity/v3/roles/service => generated 85 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 13 10:58:02.847485 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b3488f-0818-4958-8226-2b0eb489a33a None None] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:02.848085 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b3488f-0818-4958-8226-2b0eb489a33a None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:02.848292 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b3488f-0818-4958-8226-2b0eb489a33a None None] PATH_INFO: `/` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:02.852959 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 189/370] 10.222.0.18 () {54 vars in 927 bytes} [Thu Oct 13 10:58:02 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 10:58:02.853766 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b3488f-0818-4958-8226-2b0eb489a33a None None] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:02.863584 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1558ad61-0e62-4a6c-971d-21a500383b84 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:02.901613 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4abdf61-7204-4826-8a58-fb08c34dbb5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:02.902142 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4abdf61-7204-4826-8a58-fb08c34dbb5a None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:02.902439 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4abdf61-7204-4826-8a58-fb08c34dbb5a None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:02.902686 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4abdf61-7204-4826-8a58-fb08c34dbb5a None admin] PATH_INFO: `/v3/roles` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:02.903354 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4abdf61-7204-4826-8a58-fb08c34dbb5a None admin] RBAC: Adding query filter params (name=service) {{(pid=81534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 10:58:02.903651 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4abdf61-7204-4826-8a58-fb08c34dbb5a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:02.905018 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4abdf61-7204-4826-8a58-fb08c34dbb5a None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:02.913454 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 182/371] 10.222.0.18 () {56 vars in 1103 bytes} [Thu Oct 13 10:58:02 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 13 10:58:02.913454 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee230499-d7e1-4cdb-8d78-41a62faa3a18 None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:02.913454 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee230499-d7e1-4cdb-8d78-41a62faa3a18 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:02.913454 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee230499-d7e1-4cdb-8d78-41a62faa3a18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:02.928552 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:58:02.933906 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-ee230499-d7e1-4cdb-8d78-41a62faa3a18 None None] MFA Rules not processed for user `8ba31ade43694cf8bf28f7528a9ea179`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 10:58:02.935085 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-ee230499-d7e1-4cdb-8d78-41a62faa3a18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 10:58:02.978263 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b3488f-0818-4958-8226-2b0eb489a33a None None] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:03.007077 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 183/372] 10.222.0.18 () {58 vars in 1024 bytes} [Thu Oct 13 10:58:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 13 10:58:03.008103 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee230499-d7e1-4cdb-8d78-41a62faa3a18 None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:03.015870 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75345243-8a2a-44f5-9196-11b4bc40d054 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:03.016571 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75345243-8a2a-44f5-9196-11b4bc40d054 None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:03.016921 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75345243-8a2a-44f5-9196-11b4bc40d054 None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:03.017298 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75345243-8a2a-44f5-9196-11b4bc40d054 None admin] PATH_INFO: `/v3/roles` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:03.018036 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75345243-8a2a-44f5-9196-11b4bc40d054 None admin] RBAC: Adding query filter params (name=service) {{(pid=81533) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 10:58:03.018406 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75345243-8a2a-44f5-9196-11b4bc40d054 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:03.019907 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75345243-8a2a-44f5-9196-11b4bc40d054 None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:03.030081 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 190/373] 10.222.0.18 () {56 vars in 1103 bytes} [Thu Oct 13 10:58:02 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 10:58:03.030081 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75345243-8a2a-44f5-9196-11b4bc40d054 None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:03.050649 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:58:03.133615 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee230499-d7e1-4cdb-8d78-41a62faa3a18 None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:03.157335 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75345243-8a2a-44f5-9196-11b4bc40d054 None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:03.174964 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5ff852-cfad-4b44-9442-b2e9fa4272e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:03.175791 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5ff852-cfad-4b44-9442-b2e9fa4272e7 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:03.176094 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5ff852-cfad-4b44-9442-b2e9fa4272e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:03.176458 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5ff852-cfad-4b44-9442-b2e9fa4272e7 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:03.187218 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:58:03.189297 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5ff852-cfad-4b44-9442-b2e9fa4272e7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 13 10:58:03.195882 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application [None req-4a5ff852-cfad-4b44-9442-b2e9fa4272e7 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 13 10:58:03.195882 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 10:58:03.195882 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 10:58:03.195882 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 10:58:03.195882 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 10:58:03.195882 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 10:58:03.195882 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 10:58:03.195882 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 10:58:03.195882 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 10:58:03.195882 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 10:58:03.195882 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 10:58:03.195882 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 10:58:03.195882 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 13 10:58:03.195882 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 13 10:58:03.195882 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 13 10:58:03.195882 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 13 10:58:03.197046 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 13 10:58:03.197046 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 13 10:58:03.197046 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 13 10:58:03.197046 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 13 10:58:03.197046 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 10:58:03.197046 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 10:58:03.197046 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 10:58:03.197046 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 10:58:03.197046 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 10:58:03.197046 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 10:58:03.197046 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 10:58:03.197046 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application with Lock( Oct 13 10:58:03.197046 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 10:58:03.197046 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._enter() Oct 13 10:58:03.197046 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 10:58:03.197046 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 10:58:03.198178 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 10:58:03.198178 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.creator() Oct 13 10:58:03.198178 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 10:58:03.198178 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application created_value = creator( Oct 13 10:58:03.198178 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 13 10:58:03.198178 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 13 10:58:03.198178 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 13 10:58:03.198178 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 13 10:58:03.198178 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 13 10:58:03.198178 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 13 10:58:03.198178 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 13 10:58:03.198178 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application Oct 13 10:58:03.199759 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 184/374] 10.222.0.18 () {56 vars in 1102 bytes} [Thu Oct 13 10:58:03 2022] GET /identity/v3/roles/service => generated 85 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 10:58:03.204708 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5ff852-cfad-4b44-9442-b2e9fa4272e7 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:03.211061 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee89452-ea82-4bee-bcf4-20c553a8fad6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:03.212750 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee89452-ea82-4bee-bcf4-20c553a8fad6 None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:03.213220 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee89452-ea82-4bee-bcf4-20c553a8fad6 None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:03.213660 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee89452-ea82-4bee-bcf4-20c553a8fad6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:03.229399 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee89452-ea82-4bee-bcf4-20c553a8fad6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:03.231350 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee89452-ea82-4bee-bcf4-20c553a8fad6 None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:03.252417 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application [None req-aee89452-ea82-4bee-bcf4-20c553a8fad6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 13 10:58:03.252417 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 10:58:03.252417 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 10:58:03.252417 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 10:58:03.252417 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 10:58:03.252417 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 10:58:03.252417 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 10:58:03.252417 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 10:58:03.252417 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 10:58:03.252417 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 10:58:03.252417 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 10:58:03.252417 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 10:58:03.252417 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 13 10:58:03.252417 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 13 10:58:03.252417 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 13 10:58:03.252417 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 13 10:58:03.253507 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 10:58:03.253507 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 10:58:03.253507 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 10:58:03.253507 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 10:58:03.253507 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 10:58:03.253507 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 10:58:03.253507 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 10:58:03.253507 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application with Lock( Oct 13 10:58:03.253507 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 10:58:03.253507 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._enter() Oct 13 10:58:03.253507 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 10:58:03.253507 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 10:58:03.253507 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 10:58:03.253507 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.creator() Oct 13 10:58:03.253507 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 10:58:03.253507 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application created_value = creator( Oct 13 10:58:03.253507 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 13 10:58:03.254358 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 13 10:58:03.254358 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 13 10:58:03.254358 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application Oct 13 10:58:03.257155 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 191/375] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Oct 13 10:58:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 10:58:03.258710 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee89452-ea82-4bee-bcf4-20c553a8fad6 None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:03.304571 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:58:03.323095 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5ff852-cfad-4b44-9442-b2e9fa4272e7 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:03.358049 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d6d8cf-3670-43a8-929d-1c4a6de8a32a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:03.358668 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d6d8cf-3670-43a8-929d-1c4a6de8a32a None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:03.358942 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d6d8cf-3670-43a8-929d-1c4a6de8a32a None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:03.359210 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d6d8cf-3670-43a8-929d-1c4a6de8a32a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:03.369886 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d6d8cf-3670-43a8-929d-1c4a6de8a32a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:03.370930 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee89452-ea82-4bee-bcf4-20c553a8fad6 None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:03.371325 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d6d8cf-3670-43a8-929d-1c4a6de8a32a None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:03.386878 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application [None req-04d6d8cf-3670-43a8-929d-1c4a6de8a32a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 13 10:58:03.386878 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 10:58:03.386878 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 10:58:03.386878 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 10:58:03.386878 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 10:58:03.386878 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 10:58:03.386878 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 10:58:03.386878 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 10:58:03.386878 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 10:58:03.386878 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 10:58:03.386878 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 10:58:03.386878 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 10:58:03.386878 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 13 10:58:03.386878 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 13 10:58:03.386878 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 13 10:58:03.386878 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 13 10:58:03.387849 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 10:58:03.387849 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 10:58:03.387849 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 10:58:03.387849 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 10:58:03.387849 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 10:58:03.387849 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 10:58:03.387849 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 10:58:03.387849 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application with Lock( Oct 13 10:58:03.387849 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 10:58:03.387849 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._enter() Oct 13 10:58:03.387849 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 10:58:03.387849 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 10:58:03.387849 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 10:58:03.387849 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.creator() Oct 13 10:58:03.387849 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 10:58:03.387849 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application created_value = creator( Oct 13 10:58:03.387849 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 13 10:58:03.388715 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 13 10:58:03.388715 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 13 10:58:03.388715 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application Oct 13 10:58:03.388715 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 185/376] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Oct 13 10:58:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 10:58:03.393399 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d6d8cf-3670-43a8-929d-1c4a6de8a32a None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:03.410383 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5634f4-47a7-4448-b6bd-f6f88f75945c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:03.410912 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5634f4-47a7-4448-b6bd-f6f88f75945c None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:03.411185 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5634f4-47a7-4448-b6bd-f6f88f75945c None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:03.411453 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5634f4-47a7-4448-b6bd-f6f88f75945c None admin] PATH_INFO: `/v3/roles` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:03.412103 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5634f4-47a7-4448-b6bd-f6f88f75945c None admin] RBAC: Adding query filter params (name=service) {{(pid=81533) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 10:58:03.412408 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5634f4-47a7-4448-b6bd-f6f88f75945c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:03.413789 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5634f4-47a7-4448-b6bd-f6f88f75945c None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:03.427773 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 192/377] 10.222.0.18 () {56 vars in 1103 bytes} [Thu Oct 13 10:58:03 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 10:58:03.427773 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5634f4-47a7-4448-b6bd-f6f88f75945c None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:03.460678 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:58:03.507857 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d6d8cf-3670-43a8-929d-1c4a6de8a32a None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:03.526526 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5634f4-47a7-4448-b6bd-f6f88f75945c None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:03.546461 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb26fcea-6ba5-4279-afe6-d858f27dc0e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:03.547183 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb26fcea-6ba5-4279-afe6-d858f27dc0e7 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:03.547526 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb26fcea-6ba5-4279-afe6-d858f27dc0e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:03.547863 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb26fcea-6ba5-4279-afe6-d858f27dc0e7 None admin] PATH_INFO: `/v3/domains` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:03.548626 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb26fcea-6ba5-4279-afe6-d858f27dc0e7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 10:58:03.549143 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb26fcea-6ba5-4279-afe6-d858f27dc0e7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:03.550553 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb26fcea-6ba5-4279-afe6-d858f27dc0e7 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:03.553678 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:58:03.566097 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 186/378] 10.222.0.18 () {56 vars in 1109 bytes} [Thu Oct 13 10:58:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 10:58:03.566278 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4a36bb-58ef-4420-892d-89a22f5467d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:03.566592 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4a36bb-58ef-4420-892d-89a22f5467d1 None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:03.566872 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4a36bb-58ef-4420-892d-89a22f5467d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:03.567245 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4a36bb-58ef-4420-892d-89a22f5467d1 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:03.571851 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb26fcea-6ba5-4279-afe6-d858f27dc0e7 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:03.578412 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4a36bb-58ef-4420-892d-89a22f5467d1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 13 10:58:03.583273 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application [None req-fd4a36bb-58ef-4420-892d-89a22f5467d1 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 13 10:58:03.583273 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 10:58:03.583273 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 10:58:03.583273 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 10:58:03.583273 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 10:58:03.583273 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 10:58:03.583273 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 10:58:03.583273 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 10:58:03.583273 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 10:58:03.583273 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 10:58:03.583273 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 10:58:03.583273 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 10:58:03.583273 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 13 10:58:03.583273 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 13 10:58:03.583273 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 13 10:58:03.583273 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 13 10:58:03.584351 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 13 10:58:03.584351 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 13 10:58:03.584351 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 13 10:58:03.584351 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 13 10:58:03.584351 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 10:58:03.584351 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 10:58:03.584351 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 10:58:03.584351 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 10:58:03.584351 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 10:58:03.584351 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 10:58:03.584351 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 10:58:03.584351 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application with Lock( Oct 13 10:58:03.584351 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 10:58:03.584351 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._enter() Oct 13 10:58:03.584351 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 10:58:03.584351 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 10:58:03.586686 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 10:58:03.586686 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.creator() Oct 13 10:58:03.586686 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 10:58:03.586686 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application created_value = creator( Oct 13 10:58:03.586686 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 13 10:58:03.586686 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 13 10:58:03.586686 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 13 10:58:03.586686 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 13 10:58:03.586686 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 13 10:58:03.586686 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 13 10:58:03.586686 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 13 10:58:03.586686 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application Oct 13 10:58:03.586686 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 193/379] 10.222.0.18 () {56 vars in 1102 bytes} [Thu Oct 13 10:58:03 2022] GET /identity/v3/roles/service => generated 85 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 10:58:03.586686 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4a36bb-58ef-4420-892d-89a22f5467d1 None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:03.679218 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb26fcea-6ba5-4279-afe6-d858f27dc0e7 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:03.685703 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:58:03.692535 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4a36bb-58ef-4420-892d-89a22f5467d1 None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:03.713604 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a565b612-75df-414d-8eb6-a7f0c90517c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:03.714212 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a565b612-75df-414d-8eb6-a7f0c90517c8 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:03.714487 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a565b612-75df-414d-8eb6-a7f0c90517c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:03.714752 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a565b612-75df-414d-8eb6-a7f0c90517c8 None admin] PATH_INFO: `/v3/domains` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:03.715387 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a565b612-75df-414d-8eb6-a7f0c90517c8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 10:58:03.715682 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a565b612-75df-414d-8eb6-a7f0c90517c8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:03.717061 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a565b612-75df-414d-8eb6-a7f0c90517c8 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:03.726527 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53465871-00c6-4d21-a66f-752eb31ed9c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:03.727942 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53465871-00c6-4d21-a66f-752eb31ed9c0 None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:03.728280 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53465871-00c6-4d21-a66f-752eb31ed9c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:03.728555 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53465871-00c6-4d21-a66f-752eb31ed9c0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:03.728727 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 187/380] 10.222.0.18 () {56 vars in 1109 bytes} [Thu Oct 13 10:58:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 10:58:03.729695 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a565b612-75df-414d-8eb6-a7f0c90517c8 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:03.743928 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53465871-00c6-4d21-a66f-752eb31ed9c0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:03.745445 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53465871-00c6-4d21-a66f-752eb31ed9c0 None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:03.760516 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application [None req-53465871-00c6-4d21-a66f-752eb31ed9c0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 13 10:58:03.760516 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 10:58:03.760516 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 10:58:03.760516 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 10:58:03.760516 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 10:58:03.760516 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 10:58:03.760516 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 10:58:03.760516 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 10:58:03.760516 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 10:58:03.760516 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 10:58:03.760516 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 10:58:03.760516 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 10:58:03.760516 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 13 10:58:03.760516 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 13 10:58:03.760516 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 13 10:58:03.760516 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 13 10:58:03.761783 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 10:58:03.761783 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 10:58:03.761783 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 10:58:03.761783 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 10:58:03.761783 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 10:58:03.761783 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 10:58:03.761783 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 10:58:03.761783 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application with Lock( Oct 13 10:58:03.761783 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 10:58:03.761783 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._enter() Oct 13 10:58:03.761783 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 10:58:03.761783 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 10:58:03.761783 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 10:58:03.761783 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.creator() Oct 13 10:58:03.761783 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 10:58:03.761783 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application created_value = creator( Oct 13 10:58:03.761783 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 13 10:58:03.762659 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 13 10:58:03.762659 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 13 10:58:03.762659 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application Oct 13 10:58:03.762659 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 194/381] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Oct 13 10:58:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 10:58:03.762659 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53465871-00c6-4d21-a66f-752eb31ed9c0 None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:03.790977 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:58:03.833341 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a565b612-75df-414d-8eb6-a7f0c90517c8 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:03.863670 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53465871-00c6-4d21-a66f-752eb31ed9c0 None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:03.866084 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5deb989-7923-4551-85d3-421d636a3471 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:03.866706 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5deb989-7923-4551-85d3-421d636a3471 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:03.866987 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5deb989-7923-4551-85d3-421d636a3471 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:03.867259 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5deb989-7923-4551-85d3-421d636a3471 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:03.875343 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5deb989-7923-4551-85d3-421d636a3471 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:03.876775 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5deb989-7923-4551-85d3-421d636a3471 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:03.890086 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application [None req-b5deb989-7923-4551-85d3-421d636a3471 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 13 10:58:03.890086 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 10:58:03.890086 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 10:58:03.890086 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 10:58:03.890086 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 10:58:03.890086 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 10:58:03.890086 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 10:58:03.890086 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 10:58:03.890086 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 10:58:03.890086 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 10:58:03.890086 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 10:58:03.890086 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 10:58:03.890086 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 13 10:58:03.890086 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 13 10:58:03.890086 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 13 10:58:03.890086 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 13 10:58:03.891002 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 10:58:03.891002 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 10:58:03.891002 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 13 10:58:03.891002 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 13 10:58:03.891002 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 13 10:58:03.891002 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 13 10:58:03.891002 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 10:58:03.891002 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 10:58:03.891002 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 10:58:03.891002 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 10:58:03.891002 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 10:58:03.891002 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application with Lock( Oct 13 10:58:03.891002 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 10:58:03.891002 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._enter() Oct 13 10:58:03.891002 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 10:58:03.891002 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 10:58:03.891002 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 10:58:03.891002 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.creator() Oct 13 10:58:03.891985 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 10:58:03.891985 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application created_value = creator( Oct 13 10:58:03.891985 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 13 10:58:03.891985 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 13 10:58:03.891985 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 13 10:58:03.891985 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 13 10:58:03.891985 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 13 10:58:03.891985 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 13 10:58:03.891985 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 13 10:58:03.891985 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application Oct 13 10:58:03.891985 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 188/382] 10.222.0.18 () {56 vars in 1093 bytes} [Thu Oct 13 10:58:03 2022] GET /identity/v3/users/nova => generated 82 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 10:58:03.892569 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed40fde-2c3f-425e-bcac-112e2b063273 None None] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:03.892791 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed40fde-2c3f-425e-bcac-112e2b063273 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:03.892998 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed40fde-2c3f-425e-bcac-112e2b063273 None None] PATH_INFO: `/` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:03.894254 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 189/383] 10.222.0.18 () {54 vars in 927 bytes} [Thu Oct 13 10:58:03 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 10:58:03.894942 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed40fde-2c3f-425e-bcac-112e2b063273 None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:03.903038 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06221480-846c-43f3-a561-c4317079fd1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:03.903639 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06221480-846c-43f3-a561-c4317079fd1b None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:03.903915 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06221480-846c-43f3-a561-c4317079fd1b None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:03.904186 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06221480-846c-43f3-a561-c4317079fd1b None admin] PATH_INFO: `/v3/roles` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:03.904850 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06221480-846c-43f3-a561-c4317079fd1b None admin] RBAC: Adding query filter params (name=service) {{(pid=81533) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 10:58:03.905184 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06221480-846c-43f3-a561-c4317079fd1b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:03.906543 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06221480-846c-43f3-a561-c4317079fd1b None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:03.914846 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 195/384] 10.222.0.18 () {56 vars in 1103 bytes} [Thu Oct 13 10:58:03 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 10:58:03.917906 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06221480-846c-43f3-a561-c4317079fd1b None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:03.930443 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:58:03.997212 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed40fde-2c3f-425e-bcac-112e2b063273 None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:04.013782 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:58:04.017556 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06221480-846c-43f3-a561-c4317079fd1b None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:04.032470 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c20cf40-6873-49d0-bee7-d79e7508c83f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:04.033120 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c20cf40-6873-49d0-bee7-d79e7508c83f None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:04.033396 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c20cf40-6873-49d0-bee7-d79e7508c83f None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:04.033666 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c20cf40-6873-49d0-bee7-d79e7508c83f None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:04.041431 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c20cf40-6873-49d0-bee7-d79e7508c83f None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:04.042872 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c20cf40-6873-49d0-bee7-d79e7508c83f None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:04.050094 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda16efd-d1ce-4f69-a2d4-dc7ff58d1ad0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:04.050710 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda16efd-d1ce-4f69-a2d4-dc7ff58d1ad0 None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:04.050986 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda16efd-d1ce-4f69-a2d4-dc7ff58d1ad0 None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:04.051244 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda16efd-d1ce-4f69-a2d4-dc7ff58d1ad0 None admin] PATH_INFO: `/v3/domains` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:04.051879 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda16efd-d1ce-4f69-a2d4-dc7ff58d1ad0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81533) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 10:58:04.052173 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda16efd-d1ce-4f69-a2d4-dc7ff58d1ad0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:04.053542 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda16efd-d1ce-4f69-a2d4-dc7ff58d1ad0 None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:04.054053 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application [None req-9c20cf40-6873-49d0-bee7-d79e7508c83f None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Oct 13 10:58:04.054053 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 10:58:04.054053 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 10:58:04.054053 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 10:58:04.054053 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 10:58:04.054053 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 10:58:04.054053 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 10:58:04.054053 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 10:58:04.054053 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 10:58:04.054053 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 10:58:04.054053 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 10:58:04.054053 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 10:58:04.054053 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 13 10:58:04.054053 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 13 10:58:04.054053 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 13 10:58:04.054053 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 13 10:58:04.054930 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 10:58:04.054930 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 10:58:04.054930 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 13 10:58:04.054930 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 13 10:58:04.054930 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 13 10:58:04.054930 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 13 10:58:04.054930 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 10:58:04.054930 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 10:58:04.054930 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 10:58:04.054930 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 10:58:04.054930 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 10:58:04.054930 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application with Lock( Oct 13 10:58:04.054930 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 10:58:04.054930 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._enter() Oct 13 10:58:04.054930 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 10:58:04.054930 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 10:58:04.054930 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 10:58:04.054930 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.creator() Oct 13 10:58:04.056459 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 10:58:04.056459 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application created_value = creator( Oct 13 10:58:04.056459 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 13 10:58:04.056459 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 13 10:58:04.056459 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 13 10:58:04.056459 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 13 10:58:04.056459 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 13 10:58:04.056459 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 13 10:58:04.056459 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Oct 13 10:58:04.056459 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application Oct 13 10:58:04.056459 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 190/385] 10.222.0.18 () {56 vars in 1099 bytes} [Thu Oct 13 10:58:03 2022] GET /identity/v3/users/cinder => generated 84 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 10:58:04.057080 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c20cf40-6873-49d0-bee7-d79e7508c83f None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:04.072524 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 196/386] 10.222.0.18 () {56 vars in 1109 bytes} [Thu Oct 13 10:58:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 10:58:04.072524 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5136098-a1d1-46b8-952a-293f34b53809 None None] REQUEST_METHOD: `POST` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:04.072524 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5136098-a1d1-46b8-952a-293f34b53809 None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:04.072524 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5136098-a1d1-46b8-952a-293f34b53809 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:04.087408 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.auth.core [None req-c5136098-a1d1-46b8-952a-293f34b53809 None None] MFA Rules not processed for user `8ba31ade43694cf8bf28f7528a9ea179`. Rule list: `[]` (Enabled: `True`). {{(pid=81533) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 10:58:04.088588 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-c5136098-a1d1-46b8-952a-293f34b53809 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 10:58:04.149699 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:58:04.158404 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c20cf40-6873-49d0-bee7-d79e7508c83f None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:04.161153 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 197/387] 10.222.0.18 () {58 vars in 1024 bytes} [Thu Oct 13 10:58:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 13 10:58:04.161967 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5136098-a1d1-46b8-952a-293f34b53809 None None] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:04.197305 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f016b887-cfb8-4c04-82b9-5a5d3158bef3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:04.198568 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f016b887-cfb8-4c04-82b9-5a5d3158bef3 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:04.198849 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f016b887-cfb8-4c04-82b9-5a5d3158bef3 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:04.199116 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f016b887-cfb8-4c04-82b9-5a5d3158bef3 None admin] PATH_INFO: `/v3/users` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:04.199845 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f016b887-cfb8-4c04-82b9-5a5d3158bef3 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 10:58:04.200151 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f016b887-cfb8-4c04-82b9-5a5d3158bef3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:04.201617 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f016b887-cfb8-4c04-82b9-5a5d3158bef3 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:04.244189 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 191/388] 10.222.0.18 () {56 vars in 1133 bytes} [Thu Oct 13 10:58:04 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 10:58:04.244189 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f016b887-cfb8-4c04-82b9-5a5d3158bef3 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:04.269539 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5136098-a1d1-46b8-952a-293f34b53809 None None] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:04.279867 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:58:04.306402 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def77e81-bc37-4f7b-88dd-80ec8602ed95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:04.307022 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def77e81-bc37-4f7b-88dd-80ec8602ed95 None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:04.307300 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def77e81-bc37-4f7b-88dd-80ec8602ed95 None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:04.307570 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def77e81-bc37-4f7b-88dd-80ec8602ed95 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:04.317635 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def77e81-bc37-4f7b-88dd-80ec8602ed95 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:04.319088 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def77e81-bc37-4f7b-88dd-80ec8602ed95 None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:04.334958 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application [None req-def77e81-bc37-4f7b-88dd-80ec8602ed95 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 13 10:58:04.334958 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 10:58:04.334958 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 10:58:04.334958 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 10:58:04.334958 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 10:58:04.334958 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 10:58:04.334958 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 10:58:04.334958 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 10:58:04.334958 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 10:58:04.334958 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 10:58:04.334958 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 10:58:04.334958 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 10:58:04.334958 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 13 10:58:04.334958 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 13 10:58:04.334958 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 13 10:58:04.334958 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 13 10:58:04.335882 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 10:58:04.335882 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 10:58:04.335882 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 10:58:04.335882 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 10:58:04.335882 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 10:58:04.335882 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 10:58:04.335882 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 10:58:04.335882 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application with Lock( Oct 13 10:58:04.335882 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 10:58:04.335882 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._enter() Oct 13 10:58:04.335882 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 10:58:04.335882 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 10:58:04.335882 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 10:58:04.335882 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.creator() Oct 13 10:58:04.335882 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 10:58:04.335882 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application created_value = creator( Oct 13 10:58:04.335882 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 13 10:58:04.337471 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 13 10:58:04.337471 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 13 10:58:04.337471 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application Oct 13 10:58:04.337471 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 198/389] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Oct 13 10:58:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 10:58:04.337471 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def77e81-bc37-4f7b-88dd-80ec8602ed95 None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:04.354129 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f016b887-cfb8-4c04-82b9-5a5d3158bef3 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:04.390773 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7204593-cc41-4472-8ec1-4745369e2091 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:04.391375 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7204593-cc41-4472-8ec1-4745369e2091 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:04.391953 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7204593-cc41-4472-8ec1-4745369e2091 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:04.391953 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7204593-cc41-4472-8ec1-4745369e2091 None admin] PATH_INFO: `/v3/users` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:04.392637 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7204593-cc41-4472-8ec1-4745369e2091 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 10:58:04.392943 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7204593-cc41-4472-8ec1-4745369e2091 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:04.393386 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:58:04.394416 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7204593-cc41-4472-8ec1-4745369e2091 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:04.413908 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 192/390] 10.222.0.18 () {56 vars in 1137 bytes} [Thu Oct 13 10:58:04 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 10:58:04.414806 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7204593-cc41-4472-8ec1-4745369e2091 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:04.447612 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def77e81-bc37-4f7b-88dd-80ec8602ed95 None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:04.481586 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc684567-7d29-4025-abaa-8765ff47d19c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:04.482202 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc684567-7d29-4025-abaa-8765ff47d19c None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:04.482475 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc684567-7d29-4025-abaa-8765ff47d19c None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:04.482738 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc684567-7d29-4025-abaa-8765ff47d19c None admin] PATH_INFO: `/v3/users/glance` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:04.489875 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc684567-7d29-4025-abaa-8765ff47d19c None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:04.491310 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc684567-7d29-4025-abaa-8765ff47d19c None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:04.503797 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application [None req-bc684567-7d29-4025-abaa-8765ff47d19c None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Oct 13 10:58:04.503797 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 10:58:04.503797 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 10:58:04.503797 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 10:58:04.503797 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 10:58:04.503797 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 10:58:04.503797 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 10:58:04.503797 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 10:58:04.503797 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 10:58:04.503797 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 10:58:04.503797 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 10:58:04.503797 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 10:58:04.503797 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 13 10:58:04.503797 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 13 10:58:04.503797 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 13 10:58:04.503797 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 13 10:58:04.504711 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 10:58:04.504711 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 10:58:04.504711 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 13 10:58:04.504711 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 13 10:58:04.504711 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 13 10:58:04.504711 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 13 10:58:04.504711 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 10:58:04.504711 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 10:58:04.504711 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 10:58:04.504711 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 10:58:04.504711 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 10:58:04.504711 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application with Lock( Oct 13 10:58:04.504711 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 10:58:04.504711 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._enter() Oct 13 10:58:04.504711 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 10:58:04.504711 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 10:58:04.504711 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 10:58:04.504711 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.creator() Oct 13 10:58:04.505650 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 10:58:04.505650 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application created_value = creator( Oct 13 10:58:04.505650 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 13 10:58:04.505650 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 13 10:58:04.505650 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 13 10:58:04.505650 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 13 10:58:04.505650 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 13 10:58:04.505650 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 13 10:58:04.505650 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Oct 13 10:58:04.505650 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application Oct 13 10:58:04.506182 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:58:04.506254 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 199/391] 10.222.0.18 () {56 vars in 1099 bytes} [Thu Oct 13 10:58:04 2022] GET /identity/v3/users/glance => generated 84 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 10:58:04.507840 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc684567-7d29-4025-abaa-8765ff47d19c None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:04.514740 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7204593-cc41-4472-8ec1-4745369e2091 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:04.549605 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2974145-bec5-492b-8f05-148aec809c5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:04.550230 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2974145-bec5-492b-8f05-148aec809c5a None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:04.550511 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2974145-bec5-492b-8f05-148aec809c5a None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:04.550783 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2974145-bec5-492b-8f05-148aec809c5a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:04.560710 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2974145-bec5-492b-8f05-148aec809c5a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:04.562192 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2974145-bec5-492b-8f05-148aec809c5a None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:04.576580 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application [None req-f2974145-bec5-492b-8f05-148aec809c5a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 13 10:58:04.576580 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 10:58:04.576580 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 10:58:04.576580 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 10:58:04.576580 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 10:58:04.576580 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 10:58:04.576580 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 10:58:04.576580 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 10:58:04.576580 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 10:58:04.576580 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 10:58:04.576580 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 10:58:04.576580 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 10:58:04.576580 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 13 10:58:04.576580 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 13 10:58:04.576580 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 13 10:58:04.576580 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 13 10:58:04.577527 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 10:58:04.577527 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 10:58:04.577527 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 10:58:04.577527 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 10:58:04.577527 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 10:58:04.577527 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 10:58:04.577527 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 10:58:04.577527 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application with Lock( Oct 13 10:58:04.577527 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 10:58:04.577527 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._enter() Oct 13 10:58:04.577527 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 10:58:04.577527 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 10:58:04.577527 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 10:58:04.577527 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.creator() Oct 13 10:58:04.577527 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 10:58:04.577527 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application created_value = creator( Oct 13 10:58:04.577527 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 13 10:58:04.578433 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 13 10:58:04.578433 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 13 10:58:04.578433 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application Oct 13 10:58:04.578433 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 193/392] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Oct 13 10:58:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 10:58:04.578433 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2974145-bec5-492b-8f05-148aec809c5a None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:04.607457 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc684567-7d29-4025-abaa-8765ff47d19c None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:04.619986 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:58:04.640923 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94e1b5d-bdfd-4925-bff1-a118d50c1bab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:04.641551 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94e1b5d-bdfd-4925-bff1-a118d50c1bab None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:04.641828 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94e1b5d-bdfd-4925-bff1-a118d50c1bab None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:04.642096 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94e1b5d-bdfd-4925-bff1-a118d50c1bab None admin] PATH_INFO: `/v3/domains` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:04.642730 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f94e1b5d-bdfd-4925-bff1-a118d50c1bab None admin] RBAC: Adding query filter params (name=Default) {{(pid=81533) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 10:58:04.643034 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f94e1b5d-bdfd-4925-bff1-a118d50c1bab None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:04.644407 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f94e1b5d-bdfd-4925-bff1-a118d50c1bab None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:04.656540 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 200/393] 10.222.0.18 () {56 vars in 1109 bytes} [Thu Oct 13 10:58:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 10:58:04.657394 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94e1b5d-bdfd-4925-bff1-a118d50c1bab None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:04.678598 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2974145-bec5-492b-8f05-148aec809c5a None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:04.712050 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16fcdf40-aeef-4ffd-a8ec-ec064e163c4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:04.712592 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fcdf40-aeef-4ffd-a8ec-ec064e163c4a None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:04.712867 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fcdf40-aeef-4ffd-a8ec-ec064e163c4a None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:04.713176 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fcdf40-aeef-4ffd-a8ec-ec064e163c4a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:04.722735 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16fcdf40-aeef-4ffd-a8ec-ec064e163c4a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:04.724165 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16fcdf40-aeef-4ffd-a8ec-ec064e163c4a None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:04.726666 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:58:04.740969 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application [None req-16fcdf40-aeef-4ffd-a8ec-ec064e163c4a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 13 10:58:04.740969 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 10:58:04.740969 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 10:58:04.740969 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 10:58:04.740969 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 10:58:04.740969 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 10:58:04.740969 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 10:58:04.740969 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 10:58:04.740969 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 10:58:04.740969 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 10:58:04.740969 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 10:58:04.740969 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 10:58:04.740969 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 13 10:58:04.740969 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 13 10:58:04.740969 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 13 10:58:04.740969 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 13 10:58:04.741942 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 10:58:04.741942 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 10:58:04.741942 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 10:58:04.741942 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 10:58:04.741942 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 10:58:04.741942 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 10:58:04.741942 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 10:58:04.741942 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application with Lock( Oct 13 10:58:04.741942 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 10:58:04.741942 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._enter() Oct 13 10:58:04.741942 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 10:58:04.741942 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 10:58:04.741942 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 10:58:04.741942 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.creator() Oct 13 10:58:04.741942 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 10:58:04.741942 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application created_value = creator( Oct 13 10:58:04.741942 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 13 10:58:04.744180 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 13 10:58:04.744180 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 13 10:58:04.744180 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application Oct 13 10:58:04.744180 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 194/394] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Oct 13 10:58:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 10:58:04.744180 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16fcdf40-aeef-4ffd-a8ec-ec064e163c4a None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:04.761152 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94e1b5d-bdfd-4925-bff1-a118d50c1bab None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:04.794565 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8511cb8b-13fb-4549-b3e6-31230aa38dbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:04.795308 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8511cb8b-13fb-4549-b3e6-31230aa38dbe None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:04.795587 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8511cb8b-13fb-4549-b3e6-31230aa38dbe None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:04.795857 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8511cb8b-13fb-4549-b3e6-31230aa38dbe None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:04.806361 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8511cb8b-13fb-4549-b3e6-31230aa38dbe None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:04.807811 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8511cb8b-13fb-4549-b3e6-31230aa38dbe None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:04.822194 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application [None req-8511cb8b-13fb-4549-b3e6-31230aa38dbe None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 13 10:58:04.822194 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 10:58:04.822194 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 10:58:04.822194 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 10:58:04.822194 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 10:58:04.822194 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 10:58:04.822194 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 10:58:04.822194 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 10:58:04.822194 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 10:58:04.822194 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 10:58:04.822194 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 10:58:04.822194 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 10:58:04.822194 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 13 10:58:04.822194 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 13 10:58:04.822194 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 13 10:58:04.822194 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 13 10:58:04.823122 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 10:58:04.823122 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 10:58:04.823122 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 10:58:04.823122 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 10:58:04.823122 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 10:58:04.823122 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 10:58:04.823122 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 10:58:04.823122 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application with Lock( Oct 13 10:58:04.823122 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 10:58:04.823122 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._enter() Oct 13 10:58:04.823122 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 10:58:04.823122 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 10:58:04.823122 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 10:58:04.823122 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.creator() Oct 13 10:58:04.823122 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 10:58:04.823122 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application created_value = creator( Oct 13 10:58:04.823122 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 13 10:58:04.824762 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 13 10:58:04.824762 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 13 10:58:04.824762 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application Oct 13 10:58:04.824762 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 201/395] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Oct 13 10:58:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 10:58:04.824762 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8511cb8b-13fb-4549-b3e6-31230aa38dbe None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:04.846726 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16fcdf40-aeef-4ffd-a8ec-ec064e163c4a None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:04.849774 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:58:04.880914 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130e82c4-6c7f-4c0c-b9e5-431e7f74daf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:04.881783 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130e82c4-6c7f-4c0c-b9e5-431e7f74daf3 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:04.882057 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130e82c4-6c7f-4c0c-b9e5-431e7f74daf3 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:04.882325 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130e82c4-6c7f-4c0c-b9e5-431e7f74daf3 None admin] PATH_INFO: `/v3/users` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:04.883116 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130e82c4-6c7f-4c0c-b9e5-431e7f74daf3 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 10:58:04.883419 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130e82c4-6c7f-4c0c-b9e5-431e7f74daf3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:04.884828 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130e82c4-6c7f-4c0c-b9e5-431e7f74daf3 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:04.902378 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 195/396] 10.222.0.18 () {56 vars in 1137 bytes} [Thu Oct 13 10:58:04 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 10:58:04.903181 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130e82c4-6c7f-4c0c-b9e5-431e7f74daf3 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:04.925295 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8511cb8b-13fb-4549-b3e6-31230aa38dbe None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:04.957405 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:58:04.958746 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f985d6d-fd8e-492d-97b2-254fa89508de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:04.959342 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f985d6d-fd8e-492d-97b2-254fa89508de None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:04.959617 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f985d6d-fd8e-492d-97b2-254fa89508de None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:04.959883 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f985d6d-fd8e-492d-97b2-254fa89508de None admin] PATH_INFO: `/v3/domains` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:04.960514 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f985d6d-fd8e-492d-97b2-254fa89508de None admin] RBAC: Adding query filter params (name=Default) {{(pid=81533) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 10:58:04.960813 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f985d6d-fd8e-492d-97b2-254fa89508de None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:04.963144 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f985d6d-fd8e-492d-97b2-254fa89508de None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:04.975462 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 202/397] 10.222.0.18 () {56 vars in 1109 bytes} [Thu Oct 13 10:58:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 10:58:04.976242 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f985d6d-fd8e-492d-97b2-254fa89508de None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:05.004303 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130e82c4-6c7f-4c0c-b9e5-431e7f74daf3 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:05.038364 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b833357-d1da-48d4-990b-8820f86a9528 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:05.038981 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b833357-d1da-48d4-990b-8820f86a9528 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:05.039305 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b833357-d1da-48d4-990b-8820f86a9528 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:05.039584 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b833357-d1da-48d4-990b-8820f86a9528 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:05.046434 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b833357-d1da-48d4-990b-8820f86a9528 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:05.047849 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b833357-d1da-48d4-990b-8820f86a9528 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:05.059213 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:58:05.060064 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application [None req-3b833357-d1da-48d4-990b-8820f86a9528 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Oct 13 10:58:05.060064 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 10:58:05.060064 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 10:58:05.060064 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 10:58:05.060064 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 10:58:05.060064 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 10:58:05.060064 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 10:58:05.060064 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 10:58:05.060064 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 10:58:05.060064 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 10:58:05.060064 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 10:58:05.060064 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 10:58:05.060064 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 13 10:58:05.060064 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 13 10:58:05.060064 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 13 10:58:05.060064 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 13 10:58:05.061515 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 10:58:05.061515 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 10:58:05.061515 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 13 10:58:05.061515 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 13 10:58:05.061515 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 13 10:58:05.061515 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 13 10:58:05.061515 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 10:58:05.061515 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 10:58:05.061515 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 10:58:05.061515 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 10:58:05.061515 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 10:58:05.061515 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application with Lock( Oct 13 10:58:05.061515 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 10:58:05.061515 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._enter() Oct 13 10:58:05.061515 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 10:58:05.061515 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 10:58:05.061515 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 10:58:05.061515 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.creator() Oct 13 10:58:05.062612 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 10:58:05.062612 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application created_value = creator( Oct 13 10:58:05.062612 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 13 10:58:05.062612 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 13 10:58:05.062612 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 13 10:58:05.062612 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 13 10:58:05.062612 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 13 10:58:05.062612 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 13 10:58:05.062612 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Oct 13 10:58:05.062612 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application Oct 13 10:58:05.062612 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 196/398] 10.222.0.18 () {56 vars in 1102 bytes} [Thu Oct 13 10:58:04 2022] GET /identity/v3/users/neutron => generated 85 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 10:58:05.062612 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b833357-d1da-48d4-990b-8820f86a9528 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:05.075970 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f985d6d-fd8e-492d-97b2-254fa89508de None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:05.110414 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174cdff5-0953-48c2-885e-1ef66566ac36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:05.111037 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174cdff5-0953-48c2-885e-1ef66566ac36 None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:05.111316 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174cdff5-0953-48c2-885e-1ef66566ac36 None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:05.111588 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174cdff5-0953-48c2-885e-1ef66566ac36 None admin] PATH_INFO: `/v3/domains` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:05.112226 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174cdff5-0953-48c2-885e-1ef66566ac36 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81533) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 10:58:05.112531 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174cdff5-0953-48c2-885e-1ef66566ac36 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:05.113937 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174cdff5-0953-48c2-885e-1ef66566ac36 None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:05.124821 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 203/399] 10.222.0.18 () {56 vars in 1109 bytes} [Thu Oct 13 10:58:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 10:58:05.125673 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174cdff5-0953-48c2-885e-1ef66566ac36 None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:05.167033 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b833357-d1da-48d4-990b-8820f86a9528 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:05.180211 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:58:05.200782 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed6c4d6-39c2-485c-a7e3-7769c37feaf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:05.201411 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed6c4d6-39c2-485c-a7e3-7769c37feaf3 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:05.201692 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed6c4d6-39c2-485c-a7e3-7769c37feaf3 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:05.202242 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed6c4d6-39c2-485c-a7e3-7769c37feaf3 None admin] PATH_INFO: `/v3/domains` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:05.202607 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed6c4d6-39c2-485c-a7e3-7769c37feaf3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 10:58:05.202908 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed6c4d6-39c2-485c-a7e3-7769c37feaf3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:05.204258 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed6c4d6-39c2-485c-a7e3-7769c37feaf3 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:05.216336 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 197/400] 10.222.0.18 () {56 vars in 1109 bytes} [Thu Oct 13 10:58:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 10:58:05.217084 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed6c4d6-39c2-485c-a7e3-7769c37feaf3 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:05.224371 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174cdff5-0953-48c2-885e-1ef66566ac36 None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:05.258008 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2364e27f-e904-4947-8945-f250df95fad2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:05.258885 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2364e27f-e904-4947-8945-f250df95fad2 None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:05.259169 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2364e27f-e904-4947-8945-f250df95fad2 None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:05.259461 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2364e27f-e904-4947-8945-f250df95fad2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:05.269730 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2364e27f-e904-4947-8945-f250df95fad2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:05.271170 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2364e27f-e904-4947-8945-f250df95fad2 None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:05.274105 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:58:05.286766 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application [None req-2364e27f-e904-4947-8945-f250df95fad2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 13 10:58:05.286766 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 10:58:05.286766 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 10:58:05.286766 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 10:58:05.286766 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 10:58:05.286766 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 10:58:05.286766 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 10:58:05.286766 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 10:58:05.286766 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 10:58:05.286766 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 10:58:05.286766 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 10:58:05.286766 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 10:58:05.286766 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 13 10:58:05.286766 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 13 10:58:05.286766 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 13 10:58:05.286766 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 13 10:58:05.287745 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 10:58:05.287745 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 10:58:05.287745 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 10:58:05.287745 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 10:58:05.287745 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 10:58:05.287745 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 10:58:05.287745 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 10:58:05.287745 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application with Lock( Oct 13 10:58:05.287745 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 10:58:05.287745 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._enter() Oct 13 10:58:05.287745 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 10:58:05.287745 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 10:58:05.287745 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 10:58:05.287745 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.creator() Oct 13 10:58:05.287745 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 10:58:05.287745 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application created_value = creator( Oct 13 10:58:05.287745 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 13 10:58:05.288627 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 13 10:58:05.288627 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 13 10:58:05.288627 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application Oct 13 10:58:05.288627 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 204/401] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Oct 13 10:58:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 10:58:05.288627 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2364e27f-e904-4947-8945-f250df95fad2 None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:05.317237 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed6c4d6-39c2-485c-a7e3-7769c37feaf3 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:05.351098 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5012bdc5-837d-4bc7-92b2-738eeb156933 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:05.351806 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5012bdc5-837d-4bc7-92b2-738eeb156933 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:05.352078 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5012bdc5-837d-4bc7-92b2-738eeb156933 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:05.352351 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5012bdc5-837d-4bc7-92b2-738eeb156933 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:05.358752 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5012bdc5-837d-4bc7-92b2-738eeb156933 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:05.360193 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5012bdc5-837d-4bc7-92b2-738eeb156933 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:05.372678 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application [None req-5012bdc5-837d-4bc7-92b2-738eeb156933 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 13 10:58:05.372678 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 10:58:05.372678 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 10:58:05.372678 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 10:58:05.372678 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 10:58:05.372678 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 10:58:05.372678 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 10:58:05.372678 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 10:58:05.372678 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 10:58:05.372678 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 10:58:05.372678 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 10:58:05.372678 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 10:58:05.372678 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 13 10:58:05.372678 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 13 10:58:05.372678 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 13 10:58:05.373739 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 13 10:58:05.373739 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 10:58:05.373739 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 10:58:05.373739 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 10:58:05.373739 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 10:58:05.373739 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 10:58:05.373739 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 10:58:05.373739 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 10:58:05.373739 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application with Lock( Oct 13 10:58:05.373739 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 10:58:05.373739 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._enter() Oct 13 10:58:05.373739 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 10:58:05.373739 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 10:58:05.373739 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 10:58:05.373739 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.creator() Oct 13 10:58:05.373739 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 10:58:05.373739 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application created_value = creator( Oct 13 10:58:05.375003 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 13 10:58:05.375003 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 13 10:58:05.375003 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 13 10:58:05.375003 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 13 10:58:05.375003 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 13 10:58:05.375003 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 13 10:58:05.375003 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 13 10:58:05.375003 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application Oct 13 10:58:05.375003 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 198/402] 10.222.0.18 () {56 vars in 1111 bytes} [Thu Oct 13 10:58:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 10:58:05.375003 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5012bdc5-837d-4bc7-92b2-738eeb156933 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:05.388527 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2364e27f-e904-4947-8945-f250df95fad2 None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:05.408671 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:58:05.422060 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2632d5-642a-4ee7-a306-3a47800f5fc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:05.422652 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2632d5-642a-4ee7-a306-3a47800f5fc7 None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:05.422927 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2632d5-642a-4ee7-a306-3a47800f5fc7 None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:05.423197 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2632d5-642a-4ee7-a306-3a47800f5fc7 None admin] PATH_INFO: `/v3/users` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:05.423917 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff2632d5-642a-4ee7-a306-3a47800f5fc7 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81533) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 10:58:05.424226 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff2632d5-642a-4ee7-a306-3a47800f5fc7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:05.425766 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff2632d5-642a-4ee7-a306-3a47800f5fc7 None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:05.461325 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 205/403] 10.222.0.18 () {56 vars in 1139 bytes} [Thu Oct 13 10:58:05 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 10:58:05.466020 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2632d5-642a-4ee7-a306-3a47800f5fc7 None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:05.478699 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5012bdc5-837d-4bc7-92b2-738eeb156933 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:05.512383 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af16675e-c772-4d21-b6d3-e3f3333fca1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:05.513000 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af16675e-c772-4d21-b6d3-e3f3333fca1d None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:05.513305 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af16675e-c772-4d21-b6d3-e3f3333fca1d None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:05.513574 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af16675e-c772-4d21-b6d3-e3f3333fca1d None admin] PATH_INFO: `/v3/projects/service` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:05.516907 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:58:05.520427 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af16675e-c772-4d21-b6d3-e3f3333fca1d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:05.521923 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af16675e-c772-4d21-b6d3-e3f3333fca1d None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:05.533001 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application [None req-af16675e-c772-4d21-b6d3-e3f3333fca1d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 13 10:58:05.533001 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 10:58:05.533001 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 10:58:05.533001 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 10:58:05.533001 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 10:58:05.533001 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 10:58:05.533001 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 10:58:05.533001 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 10:58:05.533001 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 10:58:05.533001 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 10:58:05.533001 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 10:58:05.533001 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 10:58:05.533001 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 13 10:58:05.533001 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 13 10:58:05.533001 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 13 10:58:05.534043 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 13 10:58:05.534043 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 10:58:05.534043 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 10:58:05.534043 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 10:58:05.534043 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 10:58:05.534043 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 10:58:05.534043 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 10:58:05.534043 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 10:58:05.534043 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application with Lock( Oct 13 10:58:05.534043 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 10:58:05.534043 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._enter() Oct 13 10:58:05.534043 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 10:58:05.534043 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 10:58:05.534043 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 10:58:05.534043 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.creator() Oct 13 10:58:05.534043 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 10:58:05.534043 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application created_value = creator( Oct 13 10:58:05.535224 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 13 10:58:05.535224 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 13 10:58:05.535224 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 13 10:58:05.535224 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 13 10:58:05.535224 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 13 10:58:05.535224 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 13 10:58:05.535224 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 13 10:58:05.535224 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application Oct 13 10:58:05.538660 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 199/404] 10.222.0.18 () {56 vars in 1111 bytes} [Thu Oct 13 10:58:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 10:58:05.540132 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af16675e-c772-4d21-b6d3-e3f3333fca1d None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:05.561279 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2632d5-642a-4ee7-a306-3a47800f5fc7 None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:05.596515 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbdb2d62-91c1-4be9-b682-e0441d68c466 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:05.597140 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdb2d62-91c1-4be9-b682-e0441d68c466 None admin] REQUEST_METHOD: `POST` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:05.597416 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdb2d62-91c1-4be9-b682-e0441d68c466 None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:05.597685 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdb2d62-91c1-4be9-b682-e0441d68c466 None admin] PATH_INFO: `/v3/users` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:05.598326 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbdb2d62-91c1-4be9-b682-e0441d68c466 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:05.599756 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbdb2d62-91c1-4be9-b682-e0441d68c466 None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:05.620148 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 206/405] 10.222.0.18 () {60 vars in 1132 bytes} [Thu Oct 13 10:58:05 2022] POST /identity/v3/users => generated 247 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 13 10:58:05.620954 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbdb2d62-91c1-4be9-b682-e0441d68c466 None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:05.636908 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:58:05.644591 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af16675e-c772-4d21-b6d3-e3f3333fca1d None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:05.688553 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c71022-5568-45e6-91eb-09b2bec658ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:05.689434 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c71022-5568-45e6-91eb-09b2bec658ea None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:05.690121 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c71022-5568-45e6-91eb-09b2bec658ea None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:05.690406 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c71022-5568-45e6-91eb-09b2bec658ea None admin] PATH_INFO: `/v3/domains` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:05.691438 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c71022-5568-45e6-91eb-09b2bec658ea None admin] RBAC: Adding query filter params (name=Default) {{(pid=81534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 10:58:05.691776 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c71022-5568-45e6-91eb-09b2bec658ea None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:05.693331 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c71022-5568-45e6-91eb-09b2bec658ea None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:05.716047 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 200/406] 10.222.0.18 () {56 vars in 1109 bytes} [Thu Oct 13 10:58:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 10:58:05.716047 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c71022-5568-45e6-91eb-09b2bec658ea None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:05.736038 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbdb2d62-91c1-4be9-b682-e0441d68c466 None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:05.749462 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:58:05.781265 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9e1866-0ef1-4c6b-b7c0-a838ff9f43a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:05.781888 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9e1866-0ef1-4c6b-b7c0-a838ff9f43a2 None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:05.782166 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9e1866-0ef1-4c6b-b7c0-a838ff9f43a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:05.782437 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9e1866-0ef1-4c6b-b7c0-a838ff9f43a2 None admin] PATH_INFO: `/v3/projects` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:05.783144 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9e1866-0ef1-4c6b-b7c0-a838ff9f43a2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81533) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 10:58:05.783449 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9e1866-0ef1-4c6b-b7c0-a838ff9f43a2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:05.785125 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9e1866-0ef1-4c6b-b7c0-a838ff9f43a2 None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:05.806167 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 207/407] 10.222.0.18 () {56 vars in 1148 bytes} [Thu Oct 13 10:58:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 10:58:05.807295 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9e1866-0ef1-4c6b-b7c0-a838ff9f43a2 None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:05.846626 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c71022-5568-45e6-91eb-09b2bec658ea None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:05.882960 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c0d300-44a8-4716-8e83-d50e328ed2cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:05.884258 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c0d300-44a8-4716-8e83-d50e328ed2cf None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:05.884536 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c0d300-44a8-4716-8e83-d50e328ed2cf None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:05.884861 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c0d300-44a8-4716-8e83-d50e328ed2cf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:05.895226 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c0d300-44a8-4716-8e83-d50e328ed2cf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:05.896682 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c0d300-44a8-4716-8e83-d50e328ed2cf None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:05.911484 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application [None req-b5c0d300-44a8-4716-8e83-d50e328ed2cf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 13 10:58:05.911484 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 10:58:05.911484 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 10:58:05.911484 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 10:58:05.911484 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 10:58:05.911484 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 10:58:05.911484 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 10:58:05.911484 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 10:58:05.911484 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 10:58:05.911484 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 10:58:05.911484 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 10:58:05.911484 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 10:58:05.911484 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 13 10:58:05.911484 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 13 10:58:05.911484 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 13 10:58:05.911484 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 13 10:58:05.912440 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 10:58:05.912440 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 10:58:05.912440 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 10:58:05.912440 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 10:58:05.912440 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 10:58:05.912440 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 10:58:05.912440 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 10:58:05.912440 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application with Lock( Oct 13 10:58:05.912440 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 10:58:05.912440 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._enter() Oct 13 10:58:05.912440 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 10:58:05.912440 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 10:58:05.912440 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 10:58:05.912440 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.creator() Oct 13 10:58:05.912440 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 10:58:05.912440 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application created_value = creator( Oct 13 10:58:05.912440 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 13 10:58:05.918271 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 13 10:58:05.918271 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 13 10:58:05.918271 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application Oct 13 10:58:05.918271 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 201/408] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Oct 13 10:58:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 10:58:05.918271 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c0d300-44a8-4716-8e83-d50e328ed2cf None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:05.925281 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:58:05.934721 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9e1866-0ef1-4c6b-b7c0-a838ff9f43a2 None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:05.971439 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4856c8d8-0e96-48aa-953f-eebbfcb59b11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:05.972483 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4856c8d8-0e96-48aa-953f-eebbfcb59b11 None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:05.972770 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4856c8d8-0e96-48aa-953f-eebbfcb59b11 None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:05.973072 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4856c8d8-0e96-48aa-953f-eebbfcb59b11 None admin] PATH_INFO: `/v3/projects` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:05.974054 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4856c8d8-0e96-48aa-953f-eebbfcb59b11 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81533) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 10:58:05.974366 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4856c8d8-0e96-48aa-953f-eebbfcb59b11 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:05.976342 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4856c8d8-0e96-48aa-953f-eebbfcb59b11 None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:05.997033 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 208/409] 10.222.0.18 () {56 vars in 1148 bytes} [Thu Oct 13 10:58:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 10:58:05.997033 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4856c8d8-0e96-48aa-953f-eebbfcb59b11 None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:06.022322 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c0d300-44a8-4716-8e83-d50e328ed2cf None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:06.034064 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:58:06.059129 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d13dbc3-73f5-4bf1-8701-bd6ee61b7f18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:06.060260 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d13dbc3-73f5-4bf1-8701-bd6ee61b7f18 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:06.060612 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d13dbc3-73f5-4bf1-8701-bd6ee61b7f18 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:06.060953 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d13dbc3-73f5-4bf1-8701-bd6ee61b7f18 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:06.067858 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d13dbc3-73f5-4bf1-8701-bd6ee61b7f18 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:06.069438 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d13dbc3-73f5-4bf1-8701-bd6ee61b7f18 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:06.081148 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application [None req-6d13dbc3-73f5-4bf1-8701-bd6ee61b7f18 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 13 10:58:06.081148 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 10:58:06.081148 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 10:58:06.081148 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 10:58:06.081148 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 10:58:06.081148 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 10:58:06.081148 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 10:58:06.081148 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 10:58:06.081148 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 10:58:06.081148 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 10:58:06.081148 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 10:58:06.081148 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 10:58:06.081148 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 13 10:58:06.081148 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 13 10:58:06.081148 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 13 10:58:06.082234 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 13 10:58:06.082234 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 10:58:06.082234 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 10:58:06.082234 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 10:58:06.082234 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 10:58:06.082234 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 10:58:06.082234 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 10:58:06.082234 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 10:58:06.082234 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application with Lock( Oct 13 10:58:06.082234 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 10:58:06.082234 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._enter() Oct 13 10:58:06.082234 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 10:58:06.082234 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 10:58:06.082234 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 10:58:06.082234 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.creator() Oct 13 10:58:06.082234 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 10:58:06.082234 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application created_value = creator( Oct 13 10:58:06.083314 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 13 10:58:06.083314 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 13 10:58:06.083314 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 13 10:58:06.083314 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 13 10:58:06.083314 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 13 10:58:06.083314 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 13 10:58:06.083314 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 13 10:58:06.083314 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application Oct 13 10:58:06.089340 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 202/410] 10.222.0.18 () {56 vars in 1111 bytes} [Thu Oct 13 10:58:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 10:58:06.090251 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d13dbc3-73f5-4bf1-8701-bd6ee61b7f18 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:06.110510 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4856c8d8-0e96-48aa-953f-eebbfcb59b11 None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:06.151820 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa9424f-0ecb-40c8-8405-f998b9a86fae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:06.153013 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa9424f-0ecb-40c8-8405-f998b9a86fae None admin] REQUEST_METHOD: `PUT` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:06.153505 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa9424f-0ecb-40c8-8405-f998b9a86fae None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:06.153966 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa9424f-0ecb-40c8-8405-f998b9a86fae None admin] PATH_INFO: `/v3/projects/112613528384453abe7506465609fbd8/users/bc5b13f97c0e4a31940b5b73a916af29/roles/6af7358ee6934ea2830749333f35aa5c` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:06.162147 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:58:06.174221 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa9424f-0ecb-40c8-8405-f998b9a86fae None admin] RBAC: Authorizing `identity:create_grant(project_id=112613528384453abe7506465609fbd8, user_id=bc5b13f97c0e4a31940b5b73a916af29, role_id=6af7358ee6934ea2830749333f35aa5c)` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:06.175684 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa9424f-0ecb-40c8-8405-f998b9a86fae None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:06.189306 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 209/411] 10.222.0.18 () {58 vars in 1439 bytes} [Thu Oct 13 10:58:05 2022] PUT /identity/v3/projects/112613528384453abe7506465609fbd8/users/bc5b13f97c0e4a31940b5b73a916af29/roles/6af7358ee6934ea2830749333f35aa5c => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 10:58:06.190083 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa9424f-0ecb-40c8-8405-f998b9a86fae None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:06.215173 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d13dbc3-73f5-4bf1-8701-bd6ee61b7f18 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:06.268730 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69426a5-eddf-4d01-a172-71d669703a4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:06.269722 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69426a5-eddf-4d01-a172-71d669703a4e None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:06.270486 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69426a5-eddf-4d01-a172-71d669703a4e None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:06.271951 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69426a5-eddf-4d01-a172-71d669703a4e None admin] PATH_INFO: `/v3/domains` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:06.272916 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b69426a5-eddf-4d01-a172-71d669703a4e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 10:58:06.273442 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b69426a5-eddf-4d01-a172-71d669703a4e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:06.275078 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b69426a5-eddf-4d01-a172-71d669703a4e None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:06.285149 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:58:06.295741 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 203/412] 10.222.0.18 () {56 vars in 1109 bytes} [Thu Oct 13 10:58:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 10:58:06.296949 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69426a5-eddf-4d01-a172-71d669703a4e None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:06.316601 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa9424f-0ecb-40c8-8405-f998b9a86fae None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:06.358160 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f603a4df-c18f-41c0-bd09-6c1469d4d0e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:06.358854 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f603a4df-c18f-41c0-bd09-6c1469d4d0e6 None admin] REQUEST_METHOD: `PUT` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:06.359197 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f603a4df-c18f-41c0-bd09-6c1469d4d0e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:06.359543 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f603a4df-c18f-41c0-bd09-6c1469d4d0e6 None admin] PATH_INFO: `/v3/projects/112613528384453abe7506465609fbd8/users/5bd577557f564e148ebd1dcde1e8580b/roles/6af7358ee6934ea2830749333f35aa5c` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:06.379309 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f603a4df-c18f-41c0-bd09-6c1469d4d0e6 None admin] RBAC: Authorizing `identity:create_grant(project_id=112613528384453abe7506465609fbd8, user_id=5bd577557f564e148ebd1dcde1e8580b, role_id=6af7358ee6934ea2830749333f35aa5c)` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:06.380912 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f603a4df-c18f-41c0-bd09-6c1469d4d0e6 None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:06.396411 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 210/413] 10.222.0.18 () {58 vars in 1439 bytes} [Thu Oct 13 10:58:06 2022] PUT /identity/v3/projects/112613528384453abe7506465609fbd8/users/5bd577557f564e148ebd1dcde1e8580b/roles/6af7358ee6934ea2830749333f35aa5c => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 10:58:06.397400 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f603a4df-c18f-41c0-bd09-6c1469d4d0e6 None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:06.434992 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69426a5-eddf-4d01-a172-71d669703a4e None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:06.499687 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:58:06.526859 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52087cf5-4bdd-4900-8955-d3039a757e32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:06.527390 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52087cf5-4bdd-4900-8955-d3039a757e32 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:06.527672 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52087cf5-4bdd-4900-8955-d3039a757e32 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:06.527930 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52087cf5-4bdd-4900-8955-d3039a757e32 None admin] PATH_INFO: `/v3/projects` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:06.528637 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52087cf5-4bdd-4900-8955-d3039a757e32 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 10:58:06.528937 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52087cf5-4bdd-4900-8955-d3039a757e32 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:06.530445 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52087cf5-4bdd-4900-8955-d3039a757e32 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:06.567203 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f603a4df-c18f-41c0-bd09-6c1469d4d0e6 None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:06.580089 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 204/414] 10.222.0.18 () {56 vars in 1148 bytes} [Thu Oct 13 10:58:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 10:58:06.585826 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52087cf5-4bdd-4900-8955-d3039a757e32 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:06.624110 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:58:06.636207 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309b415e-0ca0-4f6d-8413-ae31f3c067e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:06.637216 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309b415e-0ca0-4f6d-8413-ae31f3c067e1 None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:06.638681 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309b415e-0ca0-4f6d-8413-ae31f3c067e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:06.639048 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309b415e-0ca0-4f6d-8413-ae31f3c067e1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:06.649544 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309b415e-0ca0-4f6d-8413-ae31f3c067e1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:06.651202 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309b415e-0ca0-4f6d-8413-ae31f3c067e1 None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:06.667026 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application [None req-309b415e-0ca0-4f6d-8413-ae31f3c067e1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 13 10:58:06.667026 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 10:58:06.667026 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 10:58:06.667026 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 10:58:06.667026 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 10:58:06.667026 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 10:58:06.667026 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 10:58:06.667026 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 10:58:06.667026 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 10:58:06.667026 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 10:58:06.667026 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 10:58:06.667026 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 10:58:06.667026 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 13 10:58:06.667026 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 13 10:58:06.667026 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 13 10:58:06.668126 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 13 10:58:06.668126 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 10:58:06.668126 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 10:58:06.668126 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 10:58:06.668126 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 10:58:06.668126 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 10:58:06.668126 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 10:58:06.668126 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 10:58:06.668126 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application with Lock( Oct 13 10:58:06.668126 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 10:58:06.668126 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._enter() Oct 13 10:58:06.668126 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 10:58:06.668126 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 10:58:06.668126 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 10:58:06.668126 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.creator() Oct 13 10:58:06.668126 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 10:58:06.668126 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application created_value = creator( Oct 13 10:58:06.669216 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 13 10:58:06.669216 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 13 10:58:06.669216 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 13 10:58:06.669216 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 13 10:58:06.669216 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 13 10:58:06.669216 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 13 10:58:06.669216 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 13 10:58:06.669216 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application Oct 13 10:58:06.671662 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 211/415] 10.222.0.18 () {56 vars in 1111 bytes} [Thu Oct 13 10:58:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 274 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 10:58:06.677031 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309b415e-0ca0-4f6d-8413-ae31f3c067e1 None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:06.758982 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52087cf5-4bdd-4900-8955-d3039a757e32 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:06.801094 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaebf9ba-1cd9-4785-8079-6369967bf34d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:06.802088 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaebf9ba-1cd9-4785-8079-6369967bf34d None admin] REQUEST_METHOD: `PUT` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:06.802505 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaebf9ba-1cd9-4785-8079-6369967bf34d None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:06.802877 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaebf9ba-1cd9-4785-8079-6369967bf34d None admin] PATH_INFO: `/v3/projects/112613528384453abe7506465609fbd8/users/85a35c31fd1340f79ac67a10b4963b44/roles/6af7358ee6934ea2830749333f35aa5c` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:06.819805 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaebf9ba-1cd9-4785-8079-6369967bf34d None admin] RBAC: Authorizing `identity:create_grant(project_id=112613528384453abe7506465609fbd8, user_id=85a35c31fd1340f79ac67a10b4963b44, role_id=6af7358ee6934ea2830749333f35aa5c)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:06.822058 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaebf9ba-1cd9-4785-8079-6369967bf34d None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:06.842772 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 205/416] 10.222.0.18 () {58 vars in 1439 bytes} [Thu Oct 13 10:58:06 2022] PUT /identity/v3/projects/112613528384453abe7506465609fbd8/users/85a35c31fd1340f79ac67a10b4963b44/roles/6af7358ee6934ea2830749333f35aa5c => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 10:58:06.866276 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309b415e-0ca0-4f6d-8413-ae31f3c067e1 None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:06.915432 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e3683a-9957-4094-a131-370eb12b5d46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:06.916095 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e3683a-9957-4094-a131-370eb12b5d46 None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:06.916374 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e3683a-9957-4094-a131-370eb12b5d46 None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:06.916650 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e3683a-9957-4094-a131-370eb12b5d46 None admin] PATH_INFO: `/v3/projects` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:06.917434 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e3683a-9957-4094-a131-370eb12b5d46 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81533) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 10:58:06.917743 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e3683a-9957-4094-a131-370eb12b5d46 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:06.919237 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e3683a-9957-4094-a131-370eb12b5d46 None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:06.934404 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 212/417] 10.222.0.18 () {56 vars in 1148 bytes} [Thu Oct 13 10:58:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 13 10:58:06.940170 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaebf9ba-1cd9-4785-8079-6369967bf34d None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:06.993578 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:58:07.096146 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaebf9ba-1cd9-4785-8079-6369967bf34d None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:07.146000 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21c74c9-1518-4294-a6b1-f163d831fb2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:07.147058 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21c74c9-1518-4294-a6b1-f163d831fb2c None admin] REQUEST_METHOD: `PUT` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:07.147528 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21c74c9-1518-4294-a6b1-f163d831fb2c None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:07.147993 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21c74c9-1518-4294-a6b1-f163d831fb2c None admin] PATH_INFO: `/v3/projects/112613528384453abe7506465609fbd8/users/6d31effc2bc44d698b5adb5254263dc5/roles/6af7358ee6934ea2830749333f35aa5c` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:07.173906 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21c74c9-1518-4294-a6b1-f163d831fb2c None admin] RBAC: Authorizing `identity:create_grant(project_id=112613528384453abe7506465609fbd8, user_id=6d31effc2bc44d698b5adb5254263dc5, role_id=6af7358ee6934ea2830749333f35aa5c)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:07.175667 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21c74c9-1518-4294-a6b1-f163d831fb2c None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:07.199096 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 206/418] 10.222.0.18 () {58 vars in 1439 bytes} [Thu Oct 13 10:58:06 2022] PUT /identity/v3/projects/112613528384453abe7506465609fbd8/users/6d31effc2bc44d698b5adb5254263dc5/roles/6af7358ee6934ea2830749333f35aa5c => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 10:58:08.103709 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579d81c6-7b8f-4d0b-ba01-644757b3cc7b None None] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:08.104222 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579d81c6-7b8f-4d0b-ba01-644757b3cc7b None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:08.104222 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579d81c6-7b8f-4d0b-ba01-644757b3cc7b None None] PATH_INFO: `/` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:08.105797 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 213/419] 10.222.0.18 () {54 vars in 927 bytes} [Thu Oct 13 10:58:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 10:58:08.122058 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced8d811-c69e-4cdb-bca5-503d6817695a None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:08.122517 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced8d811-c69e-4cdb-bca5-503d6817695a None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:08.122616 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced8d811-c69e-4cdb-bca5-503d6817695a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:08.145098 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-ced8d811-c69e-4cdb-bca5-503d6817695a None None] MFA Rules not processed for user `8ba31ade43694cf8bf28f7528a9ea179`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 10:58:08.146317 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-ced8d811-c69e-4cdb-bca5-503d6817695a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 10:58:08.220107 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 207/420] 10.222.0.18 () {58 vars in 1024 bytes} [Thu Oct 13 10:58:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 13 10:58:08.501920 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579d81c6-7b8f-4d0b-ba01-644757b3cc7b None None] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:08.557183 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:58:08.612417 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579d81c6-7b8f-4d0b-ba01-644757b3cc7b None None] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:08.649168 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802edda0-083c-4f6d-9010-e5198056479f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:08.649805 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802edda0-083c-4f6d-9010-e5198056479f None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:08.650084 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802edda0-083c-4f6d-9010-e5198056479f None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:08.650359 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802edda0-083c-4f6d-9010-e5198056479f None admin] PATH_INFO: `/v3/roles/service` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:08.661085 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802edda0-083c-4f6d-9010-e5198056479f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 13 10:58:08.666530 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application [None req-802edda0-083c-4f6d-9010-e5198056479f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 13 10:58:08.666530 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 10:58:08.666530 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 10:58:08.666530 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 10:58:08.666530 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 10:58:08.666530 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 10:58:08.666530 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 10:58:08.666530 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 10:58:08.666530 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 10:58:08.666530 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 10:58:08.666530 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 10:58:08.666530 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 10:58:08.666530 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 13 10:58:08.666530 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 13 10:58:08.666530 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 13 10:58:08.666530 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 13 10:58:08.667430 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 13 10:58:08.667430 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 13 10:58:08.667430 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 13 10:58:08.667430 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 13 10:58:08.667430 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 10:58:08.667430 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 10:58:08.667430 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 10:58:08.667430 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 10:58:08.667430 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 10:58:08.667430 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 10:58:08.667430 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 10:58:08.667430 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application with Lock( Oct 13 10:58:08.667430 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 10:58:08.667430 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._enter() Oct 13 10:58:08.667430 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 10:58:08.667430 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 10:58:08.668257 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 10:58:08.668257 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.creator() Oct 13 10:58:08.668257 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 10:58:08.668257 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application created_value = creator( Oct 13 10:58:08.668257 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 13 10:58:08.668257 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 13 10:58:08.668257 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 13 10:58:08.668257 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 13 10:58:08.668257 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 13 10:58:08.668257 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 13 10:58:08.668257 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 13 10:58:08.668257 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application Oct 13 10:58:08.668257 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 214/421] 10.222.0.18 () {56 vars in 1102 bytes} [Thu Oct 13 10:58:08 2022] GET /identity/v3/roles/service => generated 85 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 10:58:08.673846 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced8d811-c69e-4cdb-bca5-503d6817695a None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:08.695127 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:58:08.801359 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced8d811-c69e-4cdb-bca5-503d6817695a None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:08.836889 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10cf62ff-b1c5-4bf1-bd07-5abc4fc9e854 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:08.837524 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cf62ff-b1c5-4bf1-bd07-5abc4fc9e854 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:08.837946 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cf62ff-b1c5-4bf1-bd07-5abc4fc9e854 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:08.838223 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cf62ff-b1c5-4bf1-bd07-5abc4fc9e854 None admin] PATH_INFO: `/v3/roles` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:08.838931 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10cf62ff-b1c5-4bf1-bd07-5abc4fc9e854 None admin] RBAC: Adding query filter params (name=service) {{(pid=81534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 10:58:08.839248 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10cf62ff-b1c5-4bf1-bd07-5abc4fc9e854 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:08.840718 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10cf62ff-b1c5-4bf1-bd07-5abc4fc9e854 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:08.848850 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 208/422] 10.222.0.18 () {56 vars in 1103 bytes} [Thu Oct 13 10:58:08 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 10:58:08.855094 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802edda0-083c-4f6d-9010-e5198056479f None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:08.895218 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3521a4-38dd-4d2b-8ad6-ac34c180d9a5 None None] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:08.895822 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3521a4-38dd-4d2b-8ad6-ac34c180d9a5 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:08.896289 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3521a4-38dd-4d2b-8ad6-ac34c180d9a5 None None] PATH_INFO: `/` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:08.898080 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 209/423] 10.222.0.18 () {54 vars in 927 bytes} [Thu Oct 13 10:58:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 10:58:08.904180 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5a745f-9d86-4d41-99d1-7fb4f7684336 None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:08.904722 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5a745f-9d86-4d41-99d1-7fb4f7684336 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:08.905220 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5a745f-9d86-4d41-99d1-7fb4f7684336 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:08.938095 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-ae5a745f-9d86-4d41-99d1-7fb4f7684336 None None] MFA Rules not processed for user `8ba31ade43694cf8bf28f7528a9ea179`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 10:58:08.939303 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-ae5a745f-9d86-4d41-99d1-7fb4f7684336 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 10:58:08.969035 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802edda0-083c-4f6d-9010-e5198056479f None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:08.980629 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:58:09.007123 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b04ef0-c722-4f41-a98e-4cd67dc0a713 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:09.007750 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b04ef0-c722-4f41-a98e-4cd67dc0a713 None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:09.008218 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b04ef0-c722-4f41-a98e-4cd67dc0a713 None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:09.008502 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b04ef0-c722-4f41-a98e-4cd67dc0a713 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:09.027486 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b04ef0-c722-4f41-a98e-4cd67dc0a713 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:09.031279 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b04ef0-c722-4f41-a98e-4cd67dc0a713 None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:09.052684 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application [None req-b4b04ef0-c722-4f41-a98e-4cd67dc0a713 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 13 10:58:09.052684 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 10:58:09.052684 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 10:58:09.052684 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 10:58:09.052684 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 10:58:09.052684 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 10:58:09.052684 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 10:58:09.052684 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 10:58:09.052684 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 10:58:09.052684 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 10:58:09.052684 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 10:58:09.052684 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 10:58:09.052684 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 13 10:58:09.052684 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 13 10:58:09.052684 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 13 10:58:09.052684 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 13 10:58:09.053721 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 10:58:09.053721 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 10:58:09.053721 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 10:58:09.053721 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 10:58:09.053721 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 10:58:09.053721 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 10:58:09.053721 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 10:58:09.053721 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application with Lock( Oct 13 10:58:09.053721 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 10:58:09.053721 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._enter() Oct 13 10:58:09.053721 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 10:58:09.053721 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 10:58:09.053721 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 10:58:09.053721 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.creator() Oct 13 10:58:09.053721 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 10:58:09.053721 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application created_value = creator( Oct 13 10:58:09.053721 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 13 10:58:09.054589 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 13 10:58:09.054589 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 13 10:58:09.054589 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application Oct 13 10:58:09.054589 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 215/424] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Oct 13 10:58:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 10:58:09.060161 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b04ef0-c722-4f41-a98e-4cd67dc0a713 None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:09.082318 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 210/425] 10.222.0.18 () {58 vars in 1024 bytes} [Thu Oct 13 10:58:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 13 10:58:09.089029 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836a8cf8-abb1-49c2-9830-004f6ec0c9b4 None None] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:09.089699 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836a8cf8-abb1-49c2-9830-004f6ec0c9b4 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:09.090185 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836a8cf8-abb1-49c2-9830-004f6ec0c9b4 None None] PATH_INFO: `/` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:09.091981 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 211/426] 10.222.0.18 () {54 vars in 927 bytes} [Thu Oct 13 10:58:09 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 10:58:09.096942 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868ab730-e931-4baa-9458-f44e5e9a236a None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:09.097461 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868ab730-e931-4baa-9458-f44e5e9a236a None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:09.097924 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868ab730-e931-4baa-9458-f44e5e9a236a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:09.126238 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-868ab730-e931-4baa-9458-f44e5e9a236a None None] MFA Rules not processed for user `8ba31ade43694cf8bf28f7528a9ea179`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 10:58:09.128195 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-868ab730-e931-4baa-9458-f44e5e9a236a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 10:58:09.145033 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:58:09.171884 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b04ef0-c722-4f41-a98e-4cd67dc0a713 None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:09.212095 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5c6a95-aff4-4dd6-91b2-4b370fbfad75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:09.212698 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5c6a95-aff4-4dd6-91b2-4b370fbfad75 None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:09.213106 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5c6a95-aff4-4dd6-91b2-4b370fbfad75 None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:09.213397 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5c6a95-aff4-4dd6-91b2-4b370fbfad75 None admin] PATH_INFO: `/v3/domains` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:09.214119 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5c6a95-aff4-4dd6-91b2-4b370fbfad75 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81533) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 10:58:09.214428 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5c6a95-aff4-4dd6-91b2-4b370fbfad75 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:09.216035 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5c6a95-aff4-4dd6-91b2-4b370fbfad75 None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:09.231076 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 216/427] 10.222.0.18 () {56 vars in 1109 bytes} [Thu Oct 13 10:58:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 13 10:58:09.236795 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5c6a95-aff4-4dd6-91b2-4b370fbfad75 None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:09.264895 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:58:09.280586 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 212/428] 10.222.0.18 () {58 vars in 1024 bytes} [Thu Oct 13 10:58:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 13 10:58:09.359959 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5c6a95-aff4-4dd6-91b2-4b370fbfad75 None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:09.400778 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ecc5d6-85f7-4397-b90f-cc18bea3c809 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:09.401439 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ecc5d6-85f7-4397-b90f-cc18bea3c809 None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:09.401716 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ecc5d6-85f7-4397-b90f-cc18bea3c809 None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:09.401988 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ecc5d6-85f7-4397-b90f-cc18bea3c809 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:09.412201 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ecc5d6-85f7-4397-b90f-cc18bea3c809 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:09.413693 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ecc5d6-85f7-4397-b90f-cc18bea3c809 None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:09.430313 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application [None req-b4ecc5d6-85f7-4397-b90f-cc18bea3c809 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Oct 13 10:58:09.430313 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 10:58:09.430313 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 10:58:09.430313 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 10:58:09.430313 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 10:58:09.430313 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 10:58:09.430313 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 10:58:09.430313 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 10:58:09.430313 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 10:58:09.430313 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 10:58:09.430313 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 10:58:09.430313 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 10:58:09.430313 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 13 10:58:09.430313 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 13 10:58:09.430313 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 13 10:58:09.430313 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 13 10:58:09.431285 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 10:58:09.431285 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 10:58:09.431285 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 13 10:58:09.431285 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 13 10:58:09.431285 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 13 10:58:09.431285 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 13 10:58:09.431285 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 10:58:09.431285 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 10:58:09.431285 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 10:58:09.431285 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 10:58:09.431285 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 10:58:09.431285 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application with Lock( Oct 13 10:58:09.431285 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 10:58:09.431285 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._enter() Oct 13 10:58:09.431285 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 10:58:09.431285 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 10:58:09.431285 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 10:58:09.431285 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.creator() Oct 13 10:58:09.432192 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 10:58:09.432192 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application created_value = creator( Oct 13 10:58:09.432192 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 13 10:58:09.432192 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 13 10:58:09.432192 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 13 10:58:09.432192 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 13 10:58:09.432192 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 13 10:58:09.432192 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 13 10:58:09.432192 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Oct 13 10:58:09.432192 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application Oct 13 10:58:09.432192 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 217/429] 10.222.0.18 () {56 vars in 1096 bytes} [Thu Oct 13 10:58:09 2022] GET /identity/v3/users/swift => generated 83 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 10:58:09.437381 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868ab730-e931-4baa-9458-f44e5e9a236a None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:09.488094 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ecc5d6-85f7-4397-b90f-cc18bea3c809 None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:09.634849 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868ab730-e931-4baa-9458-f44e5e9a236a None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:09.647232 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:58:09.677615 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ecc5d6-85f7-4397-b90f-cc18bea3c809 None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:09.701699 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95414d57-7568-48fa-adcd-df721eaa7beb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:09.702676 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95414d57-7568-48fa-adcd-df721eaa7beb None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:09.703695 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95414d57-7568-48fa-adcd-df721eaa7beb None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:09.704183 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95414d57-7568-48fa-adcd-df721eaa7beb None admin] PATH_INFO: `/v3/users` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:09.705429 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95414d57-7568-48fa-adcd-df721eaa7beb None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 10:58:09.706055 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95414d57-7568-48fa-adcd-df721eaa7beb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:09.707818 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95414d57-7568-48fa-adcd-df721eaa7beb None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:09.718556 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:58:09.718725 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26b011a-e4c7-4d58-a786-66657a259a25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:09.719277 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26b011a-e4c7-4d58-a786-66657a259a25 None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:09.719561 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26b011a-e4c7-4d58-a786-66657a259a25 None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:09.719938 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26b011a-e4c7-4d58-a786-66657a259a25 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:09.730922 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 213/430] 10.222.0.18 () {56 vars in 1135 bytes} [Thu Oct 13 10:58:09 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 10:58:09.731932 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95414d57-7568-48fa-adcd-df721eaa7beb None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:09.745047 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26b011a-e4c7-4d58-a786-66657a259a25 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 13 10:58:09.745047 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application [None req-f26b011a-e4c7-4d58-a786-66657a259a25 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 13 10:58:09.745047 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 10:58:09.745047 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 10:58:09.745047 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 10:58:09.745047 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 10:58:09.745047 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 10:58:09.745047 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 10:58:09.745047 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 10:58:09.745047 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 10:58:09.745047 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 10:58:09.745047 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 10:58:09.745047 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 10:58:09.745047 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 13 10:58:09.745922 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 13 10:58:09.745922 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 13 10:58:09.745922 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 13 10:58:09.745922 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 13 10:58:09.745922 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 13 10:58:09.745922 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 13 10:58:09.745922 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 13 10:58:09.745922 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 10:58:09.745922 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 10:58:09.745922 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 10:58:09.745922 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 10:58:09.745922 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 10:58:09.745922 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 10:58:09.745922 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 10:58:09.745922 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application with Lock( Oct 13 10:58:09.745922 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 10:58:09.745922 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._enter() Oct 13 10:58:09.746778 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 10:58:09.746778 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 10:58:09.746778 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 10:58:09.746778 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.creator() Oct 13 10:58:09.746778 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 10:58:09.746778 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application created_value = creator( Oct 13 10:58:09.746778 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 13 10:58:09.746778 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 13 10:58:09.746778 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 13 10:58:09.746778 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 13 10:58:09.746778 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 13 10:58:09.746778 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 13 10:58:09.746778 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 13 10:58:09.746778 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application Oct 13 10:58:09.746778 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 218/431] 10.222.0.18 () {56 vars in 1102 bytes} [Thu Oct 13 10:58:09 2022] GET /identity/v3/roles/service => generated 85 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 13 10:58:09.747543 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d425e7a5-8044-4afc-94dd-9b68e77eeec7 None None] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:09.747543 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d425e7a5-8044-4afc-94dd-9b68e77eeec7 None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:09.747679 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d425e7a5-8044-4afc-94dd-9b68e77eeec7 None None] PATH_INFO: `/` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:09.748964 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 219/432] 10.222.0.18 () {54 vars in 927 bytes} [Thu Oct 13 10:58:09 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 10:58:09.753808 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d425e7a5-8044-4afc-94dd-9b68e77eeec7 None None] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:09.840143 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95414d57-7568-48fa-adcd-df721eaa7beb None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:09.865243 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d425e7a5-8044-4afc-94dd-9b68e77eeec7 None None] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:09.873984 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a801f7-b633-4f5a-8d0f-3f64021fa99e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:09.874620 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a801f7-b633-4f5a-8d0f-3f64021fa99e None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:09.874898 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a801f7-b633-4f5a-8d0f-3f64021fa99e None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:09.875172 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a801f7-b633-4f5a-8d0f-3f64021fa99e None admin] PATH_INFO: `/v3/roles/service` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:09.885905 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a801f7-b633-4f5a-8d0f-3f64021fa99e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 13 10:58:09.890637 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application [None req-a8a801f7-b633-4f5a-8d0f-3f64021fa99e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 13 10:58:09.890637 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 10:58:09.890637 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 10:58:09.890637 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 10:58:09.890637 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 10:58:09.890637 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 10:58:09.890637 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 10:58:09.890637 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 10:58:09.890637 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 10:58:09.890637 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 10:58:09.890637 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 10:58:09.890637 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 10:58:09.890637 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 13 10:58:09.890637 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 13 10:58:09.890637 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 13 10:58:09.890637 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 13 10:58:09.891736 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 13 10:58:09.891736 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 13 10:58:09.891736 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 13 10:58:09.891736 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 13 10:58:09.891736 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 10:58:09.891736 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 10:58:09.891736 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 10:58:09.891736 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 10:58:09.891736 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 10:58:09.891736 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 10:58:09.891736 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 10:58:09.891736 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application with Lock( Oct 13 10:58:09.891736 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 10:58:09.891736 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._enter() Oct 13 10:58:09.891736 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 10:58:09.891736 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 10:58:09.892759 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 10:58:09.892759 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.creator() Oct 13 10:58:09.892759 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 10:58:09.892759 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application created_value = creator( Oct 13 10:58:09.892759 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 13 10:58:09.892759 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 13 10:58:09.892759 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 13 10:58:09.892759 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 13 10:58:09.892759 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 13 10:58:09.892759 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 13 10:58:09.892759 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 13 10:58:09.892759 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application Oct 13 10:58:09.892759 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 214/433] 10.222.0.18 () {56 vars in 1102 bytes} [Thu Oct 13 10:58:09 2022] GET /identity/v3/roles/service => generated 85 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 10:58:09.893491 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a801f7-b633-4f5a-8d0f-3f64021fa99e None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:09.910127 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f547a11-7bb1-4b9f-996b-6231c6575b98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:09.911239 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f547a11-7bb1-4b9f-996b-6231c6575b98 None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:09.912091 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f547a11-7bb1-4b9f-996b-6231c6575b98 None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:09.912572 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f547a11-7bb1-4b9f-996b-6231c6575b98 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:09.924045 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f547a11-7bb1-4b9f-996b-6231c6575b98 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:09.925541 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f547a11-7bb1-4b9f-996b-6231c6575b98 None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:09.927355 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:58:09.943657 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application [None req-6f547a11-7bb1-4b9f-996b-6231c6575b98 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 13 10:58:09.943657 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 10:58:09.943657 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 10:58:09.943657 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 10:58:09.943657 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 10:58:09.943657 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 10:58:09.943657 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 10:58:09.943657 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 10:58:09.943657 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 10:58:09.943657 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 10:58:09.943657 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 10:58:09.943657 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 10:58:09.943657 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 13 10:58:09.943657 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 13 10:58:09.943657 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 13 10:58:09.943657 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 13 10:58:09.944780 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 10:58:09.944780 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 10:58:09.944780 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 10:58:09.944780 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 10:58:09.944780 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 10:58:09.944780 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 10:58:09.944780 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 10:58:09.944780 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application with Lock( Oct 13 10:58:09.944780 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 10:58:09.944780 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._enter() Oct 13 10:58:09.944780 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 10:58:09.944780 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 10:58:09.944780 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 10:58:09.944780 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.creator() Oct 13 10:58:09.944780 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 10:58:09.944780 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application created_value = creator( Oct 13 10:58:09.944780 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 13 10:58:09.951871 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 13 10:58:09.951871 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 13 10:58:09.951871 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application Oct 13 10:58:09.951871 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 220/434] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Oct 13 10:58:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 10:58:09.951871 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff6c381-07f7-40be-adf3-30119c347f77 None None] REQUEST_METHOD: `POST` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:09.951871 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff6c381-07f7-40be-adf3-30119c347f77 None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:09.951871 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff6c381-07f7-40be-adf3-30119c347f77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:09.966294 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:58:09.970903 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.auth.core [None req-5ff6c381-07f7-40be-adf3-30119c347f77 None None] MFA Rules not processed for user `8ba31ade43694cf8bf28f7528a9ea179`. Rule list: `[]` (Enabled: `True`). {{(pid=81533) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 10:58:09.972277 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-5ff6c381-07f7-40be-adf3-30119c347f77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 10:58:10.013346 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a801f7-b633-4f5a-8d0f-3f64021fa99e None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:10.043890 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 221/435] 10.222.0.18 () {58 vars in 1024 bytes} [Thu Oct 13 10:58:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 13 10:58:10.044589 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff6c381-07f7-40be-adf3-30119c347f77 None None] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:10.061050 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b677edc0-a860-45b1-9325-4d8688f9c080 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:10.061050 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b677edc0-a860-45b1-9325-4d8688f9c080 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:10.061050 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b677edc0-a860-45b1-9325-4d8688f9c080 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:10.061050 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b677edc0-a860-45b1-9325-4d8688f9c080 None admin] PATH_INFO: `/v3/roles` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:10.061443 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b677edc0-a860-45b1-9325-4d8688f9c080 None admin] RBAC: Adding query filter params (name=service) {{(pid=81534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 10:58:10.061443 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b677edc0-a860-45b1-9325-4d8688f9c080 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:10.061443 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b677edc0-a860-45b1-9325-4d8688f9c080 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:10.071443 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 215/436] 10.222.0.18 () {56 vars in 1103 bytes} [Thu Oct 13 10:58:09 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 10:58:10.072830 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b677edc0-a860-45b1-9325-4d8688f9c080 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:10.151617 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff6c381-07f7-40be-adf3-30119c347f77 None None] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:10.173891 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:58:10.186705 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579937e1-31cf-410d-b719-f89bd782640f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:10.187306 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579937e1-31cf-410d-b719-f89bd782640f None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:10.187585 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579937e1-31cf-410d-b719-f89bd782640f None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:10.187857 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579937e1-31cf-410d-b719-f89bd782640f None admin] PATH_INFO: `/v3/roles` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:10.188546 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-579937e1-31cf-410d-b719-f89bd782640f None admin] RBAC: Adding query filter params (name=service) {{(pid=81533) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 10:58:10.188825 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-579937e1-31cf-410d-b719-f89bd782640f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:10.189039 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b677edc0-a860-45b1-9325-4d8688f9c080 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:10.190220 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-579937e1-31cf-410d-b719-f89bd782640f None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:10.198831 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 222/437] 10.222.0.18 () {56 vars in 1103 bytes} [Thu Oct 13 10:58:10 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 10:58:10.199825 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36252d13-21f7-48d1-91ff-6fb6dc2bc7bd None None] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:10.200105 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36252d13-21f7-48d1-91ff-6fb6dc2bc7bd None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:10.200380 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36252d13-21f7-48d1-91ff-6fb6dc2bc7bd None None] PATH_INFO: `/` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:10.205484 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 223/438] 10.222.0.18 () {54 vars in 927 bytes} [Thu Oct 13 10:58:10 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 10:58:10.205484 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36252d13-21f7-48d1-91ff-6fb6dc2bc7bd None None] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:10.215469 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:58:10.233478 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3b4a21-314e-46b9-8eaa-b2579aaa7e49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:10.234092 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3b4a21-314e-46b9-8eaa-b2579aaa7e49 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:10.234368 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3b4a21-314e-46b9-8eaa-b2579aaa7e49 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:10.234637 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3b4a21-314e-46b9-8eaa-b2579aaa7e49 None admin] PATH_INFO: `/v3/domains` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:10.235275 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3b4a21-314e-46b9-8eaa-b2579aaa7e49 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 10:58:10.235631 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3b4a21-314e-46b9-8eaa-b2579aaa7e49 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:10.236989 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3b4a21-314e-46b9-8eaa-b2579aaa7e49 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:10.253238 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 216/439] 10.222.0.18 () {56 vars in 1109 bytes} [Thu Oct 13 10:58:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 10:58:10.253238 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3b4a21-314e-46b9-8eaa-b2579aaa7e49 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:10.310688 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36252d13-21f7-48d1-91ff-6fb6dc2bc7bd None None] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:10.343912 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f9183b-e99c-4a9c-b239-9876d6ad1cf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:10.344531 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f9183b-e99c-4a9c-b239-9876d6ad1cf7 None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:10.344805 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f9183b-e99c-4a9c-b239-9876d6ad1cf7 None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:10.345103 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f9183b-e99c-4a9c-b239-9876d6ad1cf7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:10.355500 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f9183b-e99c-4a9c-b239-9876d6ad1cf7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:10.355842 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3b4a21-314e-46b9-8eaa-b2579aaa7e49 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:10.356940 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f9183b-e99c-4a9c-b239-9876d6ad1cf7 None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:10.371219 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application [None req-67f9183b-e99c-4a9c-b239-9876d6ad1cf7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 13 10:58:10.371219 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 10:58:10.371219 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 10:58:10.371219 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 10:58:10.371219 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 10:58:10.371219 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 10:58:10.371219 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 10:58:10.371219 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 10:58:10.371219 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 10:58:10.371219 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 10:58:10.371219 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 10:58:10.371219 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 10:58:10.371219 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 13 10:58:10.371219 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 13 10:58:10.371219 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 13 10:58:10.371219 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 13 10:58:10.372216 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 10:58:10.372216 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 10:58:10.372216 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 10:58:10.372216 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 10:58:10.372216 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 10:58:10.372216 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 10:58:10.372216 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 10:58:10.372216 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application with Lock( Oct 13 10:58:10.372216 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 10:58:10.372216 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._enter() Oct 13 10:58:10.372216 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 10:58:10.372216 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 10:58:10.372216 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 10:58:10.372216 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.creator() Oct 13 10:58:10.372216 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 10:58:10.372216 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application created_value = creator( Oct 13 10:58:10.372216 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 13 10:58:10.373120 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 13 10:58:10.373120 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 13 10:58:10.373120 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application Oct 13 10:58:10.373120 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 224/440] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Oct 13 10:58:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 10:58:10.373431 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ecc269-5a98-4c0d-afd1-510d368b53c0 None None] REQUEST_METHOD: `POST` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:10.373709 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ecc269-5a98-4c0d-afd1-510d368b53c0 None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:10.373978 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ecc269-5a98-4c0d-afd1-510d368b53c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:10.391811 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.auth.core [None req-56ecc269-5a98-4c0d-afd1-510d368b53c0 None None] MFA Rules not processed for user `8ba31ade43694cf8bf28f7528a9ea179`. Rule list: `[]` (Enabled: `True`). {{(pid=81533) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 10:58:10.392975 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-56ecc269-5a98-4c0d-afd1-510d368b53c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 10:58:10.394316 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2df6f5-fa63-4135-8938-4e2473ae0662 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:10.394940 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2df6f5-fa63-4135-8938-4e2473ae0662 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:10.395217 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2df6f5-fa63-4135-8938-4e2473ae0662 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:10.395496 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2df6f5-fa63-4135-8938-4e2473ae0662 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:10.406085 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2df6f5-fa63-4135-8938-4e2473ae0662 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:10.407490 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2df6f5-fa63-4135-8938-4e2473ae0662 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:10.423130 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:58:10.423444 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application [None req-ee2df6f5-fa63-4135-8938-4e2473ae0662 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 13 10:58:10.423444 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 10:58:10.423444 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 10:58:10.423444 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 10:58:10.423444 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 10:58:10.423444 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 10:58:10.423444 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 10:58:10.423444 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 10:58:10.423444 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 10:58:10.423444 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 10:58:10.423444 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 10:58:10.423444 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 10:58:10.423444 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 13 10:58:10.423444 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 13 10:58:10.423444 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 13 10:58:10.423444 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 13 10:58:10.424322 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 10:58:10.424322 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 10:58:10.424322 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 10:58:10.424322 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 10:58:10.424322 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 10:58:10.424322 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 10:58:10.424322 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 10:58:10.424322 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application with Lock( Oct 13 10:58:10.424322 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 10:58:10.424322 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._enter() Oct 13 10:58:10.424322 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 10:58:10.424322 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 10:58:10.424322 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 10:58:10.424322 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.creator() Oct 13 10:58:10.424322 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 10:58:10.424322 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application created_value = creator( Oct 13 10:58:10.424322 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 13 10:58:10.425224 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 13 10:58:10.425224 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 13 10:58:10.425224 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application Oct 13 10:58:10.425224 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 217/441] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Oct 13 10:58:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 10:58:10.425455 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2df6f5-fa63-4135-8938-4e2473ae0662 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:10.455599 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:58:10.463687 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 225/442] 10.222.0.18 () {58 vars in 1024 bytes} [Thu Oct 13 10:58:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 13 10:58:10.464437 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ecc269-5a98-4c0d-afd1-510d368b53c0 None None] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:10.528842 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2df6f5-fa63-4135-8938-4e2473ae0662 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:10.566803 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ec2048-7dee-488f-8a66-58bda3cb9a85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:10.567434 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ec2048-7dee-488f-8a66-58bda3cb9a85 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:10.567712 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ec2048-7dee-488f-8a66-58bda3cb9a85 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:10.567985 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ec2048-7dee-488f-8a66-58bda3cb9a85 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:10.574629 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ec2048-7dee-488f-8a66-58bda3cb9a85 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:10.576066 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ec2048-7dee-488f-8a66-58bda3cb9a85 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:10.586762 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ecc269-5a98-4c0d-afd1-510d368b53c0 None None] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:10.588270 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application [None req-b6ec2048-7dee-488f-8a66-58bda3cb9a85 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 13 10:58:10.588270 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 10:58:10.588270 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 10:58:10.588270 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 10:58:10.588270 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 10:58:10.588270 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 10:58:10.588270 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 10:58:10.588270 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 10:58:10.588270 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 10:58:10.588270 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 10:58:10.588270 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 10:58:10.588270 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 10:58:10.588270 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 13 10:58:10.588270 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 13 10:58:10.588270 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 13 10:58:10.589261 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 13 10:58:10.589261 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 10:58:10.589261 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 10:58:10.589261 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 10:58:10.589261 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 10:58:10.589261 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 10:58:10.589261 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 10:58:10.589261 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 10:58:10.589261 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application with Lock( Oct 13 10:58:10.589261 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 10:58:10.589261 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._enter() Oct 13 10:58:10.589261 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 10:58:10.589261 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 10:58:10.589261 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 10:58:10.589261 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.creator() Oct 13 10:58:10.589261 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 10:58:10.589261 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application created_value = creator( Oct 13 10:58:10.590146 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 13 10:58:10.590146 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 13 10:58:10.590146 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 13 10:58:10.590146 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 13 10:58:10.590146 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 13 10:58:10.590146 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 13 10:58:10.590146 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 13 10:58:10.590146 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application Oct 13 10:58:10.590146 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 218/443] 10.222.0.18 () {56 vars in 1111 bytes} [Thu Oct 13 10:58:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 10:58:10.590616 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ec2048-7dee-488f-8a66-58bda3cb9a85 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:10.635544 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ba54c8-dca8-4e4d-8312-b86c1f89ae71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:10.635830 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ba54c8-dca8-4e4d-8312-b86c1f89ae71 None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:10.636111 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ba54c8-dca8-4e4d-8312-b86c1f89ae71 None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:10.636382 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ba54c8-dca8-4e4d-8312-b86c1f89ae71 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:10.646957 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ba54c8-dca8-4e4d-8312-b86c1f89ae71 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 13 10:58:10.652474 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application [None req-64ba54c8-dca8-4e4d-8312-b86c1f89ae71 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 13 10:58:10.652474 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 10:58:10.652474 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 10:58:10.652474 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 10:58:10.652474 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 10:58:10.652474 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 10:58:10.652474 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 10:58:10.652474 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 10:58:10.652474 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 10:58:10.652474 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 10:58:10.652474 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 10:58:10.652474 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 10:58:10.652474 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 13 10:58:10.652474 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 13 10:58:10.652474 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 13 10:58:10.652474 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 13 10:58:10.653516 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 13 10:58:10.653516 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 13 10:58:10.653516 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 13 10:58:10.653516 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 13 10:58:10.653516 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 10:58:10.653516 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 10:58:10.653516 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 10:58:10.653516 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 10:58:10.653516 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 10:58:10.653516 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 10:58:10.653516 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 10:58:10.653516 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application with Lock( Oct 13 10:58:10.653516 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 10:58:10.653516 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._enter() Oct 13 10:58:10.653516 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 10:58:10.653516 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 10:58:10.654333 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 10:58:10.654333 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.creator() Oct 13 10:58:10.654333 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 10:58:10.654333 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application created_value = creator( Oct 13 10:58:10.654333 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 13 10:58:10.654333 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 13 10:58:10.654333 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 13 10:58:10.654333 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 13 10:58:10.654333 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 13 10:58:10.654333 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 13 10:58:10.654333 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 13 10:58:10.654333 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application Oct 13 10:58:10.654333 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 226/444] 10.222.0.18 () {56 vars in 1102 bytes} [Thu Oct 13 10:58:10 2022] GET /identity/v3/roles/service => generated 85 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 10:58:10.654333 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ba54c8-dca8-4e4d-8312-b86c1f89ae71 None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:10.685376 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:58:10.694928 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:58:10.705476 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ec2048-7dee-488f-8a66-58bda3cb9a85 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:10.741609 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072e444d-b701-4869-b6eb-c9de5c5ce235 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:10.742672 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072e444d-b701-4869-b6eb-c9de5c5ce235 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:10.742948 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072e444d-b701-4869-b6eb-c9de5c5ce235 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:10.743221 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072e444d-b701-4869-b6eb-c9de5c5ce235 None admin] PATH_INFO: `/v3/domains` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:10.743865 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072e444d-b701-4869-b6eb-c9de5c5ce235 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 10:58:10.744164 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072e444d-b701-4869-b6eb-c9de5c5ce235 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:10.745568 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072e444d-b701-4869-b6eb-c9de5c5ce235 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:10.758430 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 219/445] 10.222.0.18 () {56 vars in 1109 bytes} [Thu Oct 13 10:58:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 10:58:10.759505 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072e444d-b701-4869-b6eb-c9de5c5ce235 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:10.765608 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ba54c8-dca8-4e4d-8312-b86c1f89ae71 None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:10.799809 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c90291-c9e5-48ca-bd7d-0de9770fbd47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:10.800410 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c90291-c9e5-48ca-bd7d-0de9770fbd47 None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:10.800692 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c90291-c9e5-48ca-bd7d-0de9770fbd47 None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:10.800965 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c90291-c9e5-48ca-bd7d-0de9770fbd47 None admin] PATH_INFO: `/v3/domains` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:10.803485 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c90291-c9e5-48ca-bd7d-0de9770fbd47 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81533) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 10:58:10.803790 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c90291-c9e5-48ca-bd7d-0de9770fbd47 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:10.805378 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c90291-c9e5-48ca-bd7d-0de9770fbd47 None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:10.816289 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 227/446] 10.222.0.18 () {56 vars in 1109 bytes} [Thu Oct 13 10:58:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 10:58:10.817097 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c90291-c9e5-48ca-bd7d-0de9770fbd47 None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:10.859720 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072e444d-b701-4869-b6eb-c9de5c5ce235 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:10.893981 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4483478a-bf2e-4c86-90b2-c9502a79a7b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:10.894583 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4483478a-bf2e-4c86-90b2-c9502a79a7b2 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:10.894862 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4483478a-bf2e-4c86-90b2-c9502a79a7b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:10.895135 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4483478a-bf2e-4c86-90b2-c9502a79a7b2 None admin] PATH_INFO: `/v3/projects` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:10.895831 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4483478a-bf2e-4c86-90b2-c9502a79a7b2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 10:58:10.896131 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4483478a-bf2e-4c86-90b2-c9502a79a7b2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:10.897584 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4483478a-bf2e-4c86-90b2-c9502a79a7b2 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:10.903382 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:58:10.909511 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 220/447] 10.222.0.18 () {56 vars in 1148 bytes} [Thu Oct 13 10:58:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 10:58:10.910309 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4483478a-bf2e-4c86-90b2-c9502a79a7b2 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:10.915661 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c90291-c9e5-48ca-bd7d-0de9770fbd47 None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:10.922347 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:58:10.950222 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59aa3c82-87a8-452f-9e33-00ad38cde59c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:10.950756 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59aa3c82-87a8-452f-9e33-00ad38cde59c None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:10.951036 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59aa3c82-87a8-452f-9e33-00ad38cde59c None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:10.951333 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59aa3c82-87a8-452f-9e33-00ad38cde59c None admin] PATH_INFO: `/v3/roles` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:10.951989 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59aa3c82-87a8-452f-9e33-00ad38cde59c None admin] RBAC: Adding query filter params (name=service) {{(pid=81533) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 10:58:10.952290 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59aa3c82-87a8-452f-9e33-00ad38cde59c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:10.953672 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59aa3c82-87a8-452f-9e33-00ad38cde59c None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:10.962670 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 228/448] 10.222.0.18 () {56 vars in 1103 bytes} [Thu Oct 13 10:58:10 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 10:58:10.963451 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59aa3c82-87a8-452f-9e33-00ad38cde59c None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:11.009108 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4483478a-bf2e-4c86-90b2-c9502a79a7b2 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:11.042324 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dcd92c3-ca1c-4c86-a08a-1c4dd6dafd5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:11.042946 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcd92c3-ca1c-4c86-a08a-1c4dd6dafd5f None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:11.043225 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcd92c3-ca1c-4c86-a08a-1c4dd6dafd5f None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:11.043496 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcd92c3-ca1c-4c86-a08a-1c4dd6dafd5f None admin] PATH_INFO: `/v3/roles/service` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:11.053628 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dcd92c3-ca1c-4c86-a08a-1c4dd6dafd5f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 13 10:58:11.059390 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application [None req-1dcd92c3-ca1c-4c86-a08a-1c4dd6dafd5f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 13 10:58:11.059390 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 10:58:11.059390 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 10:58:11.059390 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 10:58:11.059390 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 10:58:11.059390 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 10:58:11.059390 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 10:58:11.059390 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 10:58:11.059390 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 10:58:11.059390 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 10:58:11.059390 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 10:58:11.059390 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 10:58:11.059390 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 13 10:58:11.059390 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 13 10:58:11.059390 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 13 10:58:11.059390 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 13 10:58:11.060300 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 13 10:58:11.060300 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 13 10:58:11.060300 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 13 10:58:11.060300 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 13 10:58:11.060300 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 10:58:11.060300 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 10:58:11.060300 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 10:58:11.060300 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 10:58:11.060300 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 10:58:11.060300 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 10:58:11.060300 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 10:58:11.060300 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application with Lock( Oct 13 10:58:11.060300 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 10:58:11.060300 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._enter() Oct 13 10:58:11.060300 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 10:58:11.060300 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 10:58:11.061529 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 10:58:11.061529 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.creator() Oct 13 10:58:11.061529 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 10:58:11.061529 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application created_value = creator( Oct 13 10:58:11.061529 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 13 10:58:11.061529 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 13 10:58:11.061529 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 13 10:58:11.061529 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 13 10:58:11.061529 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 13 10:58:11.061529 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 13 10:58:11.061529 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 13 10:58:11.061529 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application Oct 13 10:58:11.061529 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 221/449] 10.222.0.18 () {56 vars in 1102 bytes} [Thu Oct 13 10:58:10 2022] GET /identity/v3/roles/service => generated 85 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 10:58:11.061529 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dcd92c3-ca1c-4c86-a08a-1c4dd6dafd5f None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:11.062255 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59aa3c82-87a8-452f-9e33-00ad38cde59c None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:11.099449 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a40fa2f-4a33-4ac3-a278-cde489b4e718 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:11.100064 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a40fa2f-4a33-4ac3-a278-cde489b4e718 None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:11.100341 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a40fa2f-4a33-4ac3-a278-cde489b4e718 None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:11.100609 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a40fa2f-4a33-4ac3-a278-cde489b4e718 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:11.108143 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a40fa2f-4a33-4ac3-a278-cde489b4e718 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:11.109601 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a40fa2f-4a33-4ac3-a278-cde489b4e718 None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:11.121402 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application [None req-5a40fa2f-4a33-4ac3-a278-cde489b4e718 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Oct 13 10:58:11.121402 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 10:58:11.121402 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 10:58:11.121402 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 10:58:11.121402 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 10:58:11.121402 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 10:58:11.121402 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 10:58:11.121402 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 10:58:11.121402 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 10:58:11.121402 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 10:58:11.121402 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 10:58:11.121402 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 10:58:11.121402 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 13 10:58:11.121402 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 13 10:58:11.121402 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 13 10:58:11.121402 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 13 10:58:11.122320 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 10:58:11.122320 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 10:58:11.122320 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 13 10:58:11.122320 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 13 10:58:11.122320 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 13 10:58:11.122320 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 13 10:58:11.122320 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 10:58:11.122320 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 10:58:11.122320 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 10:58:11.122320 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 10:58:11.122320 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 10:58:11.122320 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application with Lock( Oct 13 10:58:11.122320 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 10:58:11.122320 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._enter() Oct 13 10:58:11.122320 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 10:58:11.122320 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 10:58:11.122320 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 10:58:11.122320 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.creator() Oct 13 10:58:11.123245 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 10:58:11.123245 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application created_value = creator( Oct 13 10:58:11.123245 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 13 10:58:11.123245 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 13 10:58:11.123245 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 13 10:58:11.123245 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 13 10:58:11.123245 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 13 10:58:11.123245 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 13 10:58:11.123245 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Oct 13 10:58:11.123245 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application Oct 13 10:58:11.123245 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 229/450] 10.222.0.18 () {56 vars in 1099 bytes} [Thu Oct 13 10:58:10 2022] GET /identity/v3/users/cinder => generated 84 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 10:58:11.123245 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a40fa2f-4a33-4ac3-a278-cde489b4e718 None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:11.132053 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:58:11.139542 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:58:11.162650 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dcd92c3-ca1c-4c86-a08a-1c4dd6dafd5f None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:11.194869 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c32497-6f63-4a09-8961-f978b039281f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:11.196030 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c32497-6f63-4a09-8961-f978b039281f None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:11.196303 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c32497-6f63-4a09-8961-f978b039281f None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:11.196555 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c32497-6f63-4a09-8961-f978b039281f None admin] PATH_INFO: `/v3/users/nova` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:11.204047 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c32497-6f63-4a09-8961-f978b039281f None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:11.205433 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c32497-6f63-4a09-8961-f978b039281f None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:11.216217 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application [None req-58c32497-6f63-4a09-8961-f978b039281f None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 13 10:58:11.216217 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 10:58:11.216217 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 10:58:11.216217 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 10:58:11.216217 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 10:58:11.216217 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 10:58:11.216217 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 10:58:11.216217 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 10:58:11.216217 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 10:58:11.216217 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 10:58:11.216217 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 10:58:11.216217 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 10:58:11.216217 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 13 10:58:11.216217 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 13 10:58:11.216217 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 13 10:58:11.216217 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 13 10:58:11.217160 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 10:58:11.217160 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 10:58:11.217160 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 13 10:58:11.217160 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 13 10:58:11.217160 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 13 10:58:11.217160 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 13 10:58:11.217160 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 10:58:11.217160 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 10:58:11.217160 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 10:58:11.217160 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 10:58:11.217160 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 10:58:11.217160 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application with Lock( Oct 13 10:58:11.217160 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 10:58:11.217160 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._enter() Oct 13 10:58:11.217160 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 10:58:11.217160 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 10:58:11.217160 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 10:58:11.217160 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.creator() Oct 13 10:58:11.218106 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 10:58:11.218106 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application created_value = creator( Oct 13 10:58:11.218106 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 13 10:58:11.218106 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 13 10:58:11.218106 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 13 10:58:11.218106 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 13 10:58:11.218106 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 13 10:58:11.218106 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 13 10:58:11.218106 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 13 10:58:11.218106 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application Oct 13 10:58:11.218106 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 222/451] 10.222.0.18 () {56 vars in 1093 bytes} [Thu Oct 13 10:58:11 2022] GET /identity/v3/users/nova => generated 82 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 10:58:11.219598 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c32497-6f63-4a09-8961-f978b039281f None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:11.226956 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a40fa2f-4a33-4ac3-a278-cde489b4e718 None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:11.261094 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ab1bf9-bf69-402e-9c29-d498a3932320 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:11.261747 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ab1bf9-bf69-402e-9c29-d498a3932320 None admin] REQUEST_METHOD: `PUT` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:11.262033 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ab1bf9-bf69-402e-9c29-d498a3932320 None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:11.262308 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ab1bf9-bf69-402e-9c29-d498a3932320 None admin] PATH_INFO: `/v3/projects/112613528384453abe7506465609fbd8/users/8fd17114a6034faab30c9003add7199d/roles/6af7358ee6934ea2830749333f35aa5c` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:11.277289 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ab1bf9-bf69-402e-9c29-d498a3932320 None admin] RBAC: Authorizing `identity:create_grant(project_id=112613528384453abe7506465609fbd8, user_id=8fd17114a6034faab30c9003add7199d, role_id=6af7358ee6934ea2830749333f35aa5c)` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:11.278742 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ab1bf9-bf69-402e-9c29-d498a3932320 None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:11.291029 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 230/452] 10.222.0.18 () {58 vars in 1439 bytes} [Thu Oct 13 10:58:11 2022] PUT /identity/v3/projects/112613528384453abe7506465609fbd8/users/8fd17114a6034faab30c9003add7199d/roles/6af7358ee6934ea2830749333f35aa5c => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 10:58:11.302816 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ab1bf9-bf69-402e-9c29-d498a3932320 None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:11.332452 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c32497-6f63-4a09-8961-f978b039281f None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:11.362495 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:58:11.370175 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c2dffe-ce32-4584-95c1-ce624c74dc31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:11.370839 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c2dffe-ce32-4584-95c1-ce624c74dc31 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:11.371105 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c2dffe-ce32-4584-95c1-ce624c74dc31 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:11.371374 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c2dffe-ce32-4584-95c1-ce624c74dc31 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:11.372465 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:58:11.384768 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c2dffe-ce32-4584-95c1-ce624c74dc31 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:11.386458 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c2dffe-ce32-4584-95c1-ce624c74dc31 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:11.404332 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application [None req-85c2dffe-ce32-4584-95c1-ce624c74dc31 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 13 10:58:11.404332 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 10:58:11.404332 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 10:58:11.404332 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 10:58:11.404332 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 10:58:11.404332 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 10:58:11.404332 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 10:58:11.404332 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 10:58:11.404332 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 10:58:11.404332 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 10:58:11.404332 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 10:58:11.404332 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 10:58:11.404332 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 13 10:58:11.404332 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 13 10:58:11.404332 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 13 10:58:11.404332 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 13 10:58:11.405397 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 10:58:11.405397 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 10:58:11.405397 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 10:58:11.405397 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 10:58:11.405397 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 10:58:11.405397 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 10:58:11.405397 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 10:58:11.405397 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application with Lock( Oct 13 10:58:11.405397 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 10:58:11.405397 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._enter() Oct 13 10:58:11.405397 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 10:58:11.405397 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 10:58:11.405397 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 10:58:11.405397 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.creator() Oct 13 10:58:11.405397 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 10:58:11.405397 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application created_value = creator( Oct 13 10:58:11.405397 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 13 10:58:11.406290 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 13 10:58:11.406290 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 13 10:58:11.406290 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application Oct 13 10:58:11.406290 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 223/453] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Oct 13 10:58:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 10:58:11.406290 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c2dffe-ce32-4584-95c1-ce624c74dc31 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:11.430604 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ab1bf9-bf69-402e-9c29-d498a3932320 None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:11.468143 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53abeda0-6edd-4181-a5da-841b895407ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:11.468996 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53abeda0-6edd-4181-a5da-841b895407ee None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:11.469939 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53abeda0-6edd-4181-a5da-841b895407ee None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:11.469939 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53abeda0-6edd-4181-a5da-841b895407ee None admin] PATH_INFO: `/v3/roles` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:11.470209 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53abeda0-6edd-4181-a5da-841b895407ee None admin] RBAC: Adding query filter params (name=service) {{(pid=81533) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 10:58:11.471042 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53abeda0-6edd-4181-a5da-841b895407ee None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:11.472435 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53abeda0-6edd-4181-a5da-841b895407ee None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:11.481507 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 231/454] 10.222.0.18 () {56 vars in 1103 bytes} [Thu Oct 13 10:58:11 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 10:58:11.482332 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53abeda0-6edd-4181-a5da-841b895407ee None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:11.528312 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c2dffe-ce32-4584-95c1-ce624c74dc31 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:11.562031 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0d1290-c83a-4e45-8924-95ed81403a5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:11.562633 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0d1290-c83a-4e45-8924-95ed81403a5e None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:11.562911 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0d1290-c83a-4e45-8924-95ed81403a5e None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:11.563179 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0d1290-c83a-4e45-8924-95ed81403a5e None admin] PATH_INFO: `/v3/users` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:11.563901 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb0d1290-c83a-4e45-8924-95ed81403a5e None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 10:58:11.564201 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb0d1290-c83a-4e45-8924-95ed81403a5e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:11.565654 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb0d1290-c83a-4e45-8924-95ed81403a5e None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:11.583853 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 224/455] 10.222.0.18 () {56 vars in 1137 bytes} [Thu Oct 13 10:58:11 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 10:58:11.588557 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0d1290-c83a-4e45-8924-95ed81403a5e None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:11.589024 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53abeda0-6edd-4181-a5da-841b895407ee None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:11.611893 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:58:11.624592 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1407c39d-54e6-4d19-ab54-1deab111e3ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:11.625229 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1407c39d-54e6-4d19-ab54-1deab111e3ad None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:11.625508 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1407c39d-54e6-4d19-ab54-1deab111e3ad None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:11.625778 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1407c39d-54e6-4d19-ab54-1deab111e3ad None admin] PATH_INFO: `/v3/users` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:11.626497 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1407c39d-54e6-4d19-ab54-1deab111e3ad None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81533) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 10:58:11.626801 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1407c39d-54e6-4d19-ab54-1deab111e3ad None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:11.628231 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1407c39d-54e6-4d19-ab54-1deab111e3ad None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:11.634800 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:58:11.651909 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 232/456] 10.222.0.18 () {56 vars in 1133 bytes} [Thu Oct 13 10:58:11 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 10:58:11.651909 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1407c39d-54e6-4d19-ab54-1deab111e3ad None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:11.700969 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0d1290-c83a-4e45-8924-95ed81403a5e None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:11.739543 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e36de17-81bb-4217-bc30-61ef54b14a4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:11.740217 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e36de17-81bb-4217-bc30-61ef54b14a4f None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:11.740504 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e36de17-81bb-4217-bc30-61ef54b14a4f None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:11.740779 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e36de17-81bb-4217-bc30-61ef54b14a4f None admin] PATH_INFO: `/v3/domains` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:11.741470 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e36de17-81bb-4217-bc30-61ef54b14a4f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 10:58:11.744647 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e36de17-81bb-4217-bc30-61ef54b14a4f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:11.746062 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e36de17-81bb-4217-bc30-61ef54b14a4f None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:11.757092 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1407c39d-54e6-4d19-ab54-1deab111e3ad None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:11.758682 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 225/457] 10.222.0.18 () {56 vars in 1109 bytes} [Thu Oct 13 10:58:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 10:58:11.759788 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e36de17-81bb-4217-bc30-61ef54b14a4f None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:11.801801 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d886406-ee1e-43b2-b908-4dbfc55a5d3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:11.802426 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d886406-ee1e-43b2-b908-4dbfc55a5d3b None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:11.802702 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d886406-ee1e-43b2-b908-4dbfc55a5d3b None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:11.802968 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d886406-ee1e-43b2-b908-4dbfc55a5d3b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:11.813567 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d886406-ee1e-43b2-b908-4dbfc55a5d3b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:11.815019 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d886406-ee1e-43b2-b908-4dbfc55a5d3b None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:11.830094 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application [None req-7d886406-ee1e-43b2-b908-4dbfc55a5d3b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 13 10:58:11.830094 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 10:58:11.830094 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 10:58:11.830094 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 10:58:11.830094 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 10:58:11.830094 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 10:58:11.830094 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 10:58:11.830094 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 10:58:11.830094 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 10:58:11.830094 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 10:58:11.830094 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 10:58:11.830094 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 10:58:11.830094 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 13 10:58:11.830094 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 13 10:58:11.830094 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 13 10:58:11.830094 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 13 10:58:11.831049 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 10:58:11.831049 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 10:58:11.831049 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 10:58:11.831049 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 10:58:11.831049 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 10:58:11.831049 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 10:58:11.831049 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 10:58:11.831049 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application with Lock( Oct 13 10:58:11.831049 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 10:58:11.831049 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._enter() Oct 13 10:58:11.831049 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 10:58:11.831049 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 10:58:11.831049 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 10:58:11.831049 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.creator() Oct 13 10:58:11.831049 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 10:58:11.831049 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application created_value = creator( Oct 13 10:58:11.831049 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 13 10:58:11.831904 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 13 10:58:11.831904 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 13 10:58:11.831904 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application Oct 13 10:58:11.831904 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 233/458] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Oct 13 10:58:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 10:58:11.832164 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d886406-ee1e-43b2-b908-4dbfc55a5d3b None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:11.867369 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:58:11.880443 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:58:11.884098 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e36de17-81bb-4217-bc30-61ef54b14a4f None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:11.920694 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8915c9e5-b69d-49d9-b0e9-f3f6777df961 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:11.921313 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8915c9e5-b69d-49d9-b0e9-f3f6777df961 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:11.921750 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8915c9e5-b69d-49d9-b0e9-f3f6777df961 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:11.922025 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8915c9e5-b69d-49d9-b0e9-f3f6777df961 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:11.941349 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d886406-ee1e-43b2-b908-4dbfc55a5d3b None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:11.977468 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97728143-accd-45e3-8cce-311adaebb9eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:11.978082 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97728143-accd-45e3-8cce-311adaebb9eb None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:11.978362 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97728143-accd-45e3-8cce-311adaebb9eb None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:11.978634 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97728143-accd-45e3-8cce-311adaebb9eb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:11.994426 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8915c9e5-b69d-49d9-b0e9-f3f6777df961 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:11.995826 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8915c9e5-b69d-49d9-b0e9-f3f6777df961 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:12.047747 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97728143-accd-45e3-8cce-311adaebb9eb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:12.049226 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97728143-accd-45e3-8cce-311adaebb9eb None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:12.078191 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:58:12.103815 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:58:12.108407 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 226/459] 10.222.0.18 () {58 vars in 1282 bytes} [Thu Oct 13 10:58:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 13 10:58:12.109203 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8915c9e5-b69d-49d9-b0e9-f3f6777df961 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:12.154900 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 234/460] 10.222.0.18 () {58 vars in 1282 bytes} [Thu Oct 13 10:58:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 13 10:58:12.156151 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97728143-accd-45e3-8cce-311adaebb9eb None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:12.220439 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8915c9e5-b69d-49d9-b0e9-f3f6777df961 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:12.254319 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a2a795-4be5-4d8c-97bc-8d639e6e1450 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:12.254863 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a2a795-4be5-4d8c-97bc-8d639e6e1450 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:12.255136 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a2a795-4be5-4d8c-97bc-8d639e6e1450 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:12.255401 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a2a795-4be5-4d8c-97bc-8d639e6e1450 None admin] PATH_INFO: `/v3/users/glance` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:12.259436 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97728143-accd-45e3-8cce-311adaebb9eb None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:12.263232 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a2a795-4be5-4d8c-97bc-8d639e6e1450 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:12.264771 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a2a795-4be5-4d8c-97bc-8d639e6e1450 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:12.278603 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application [None req-a9a2a795-4be5-4d8c-97bc-8d639e6e1450 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Oct 13 10:58:12.278603 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 10:58:12.278603 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 10:58:12.278603 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 10:58:12.278603 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 10:58:12.278603 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 10:58:12.278603 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 10:58:12.278603 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 10:58:12.278603 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 10:58:12.278603 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 10:58:12.278603 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 10:58:12.278603 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 10:58:12.278603 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 13 10:58:12.278603 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 13 10:58:12.278603 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 13 10:58:12.278603 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 13 10:58:12.279521 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 10:58:12.279521 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 10:58:12.279521 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 13 10:58:12.279521 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 13 10:58:12.279521 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 13 10:58:12.279521 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 13 10:58:12.279521 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 10:58:12.279521 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 10:58:12.279521 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 10:58:12.279521 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 10:58:12.279521 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 10:58:12.279521 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application with Lock( Oct 13 10:58:12.279521 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 10:58:12.279521 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._enter() Oct 13 10:58:12.279521 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 10:58:12.279521 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 10:58:12.279521 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 10:58:12.279521 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.creator() Oct 13 10:58:12.280435 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 10:58:12.280435 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application created_value = creator( Oct 13 10:58:12.280435 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 13 10:58:12.280435 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 13 10:58:12.280435 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 13 10:58:12.280435 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 13 10:58:12.280435 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 13 10:58:12.280435 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 13 10:58:12.280435 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Oct 13 10:58:12.280435 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application Oct 13 10:58:12.280435 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 227/461] 10.222.0.18 () {56 vars in 1099 bytes} [Thu Oct 13 10:58:12 2022] GET /identity/v3/users/glance => generated 84 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 10:58:12.281775 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a2a795-4be5-4d8c-97bc-8d639e6e1450 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:12.291970 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:58:12.297484 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce154b8d-8b98-4f24-a528-7132f72f955e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:12.298067 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce154b8d-8b98-4f24-a528-7132f72f955e None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:12.298344 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce154b8d-8b98-4f24-a528-7132f72f955e None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:12.298611 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce154b8d-8b98-4f24-a528-7132f72f955e None admin] PATH_INFO: `/v3/domains` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:12.299243 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce154b8d-8b98-4f24-a528-7132f72f955e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81533) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 10:58:12.299540 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce154b8d-8b98-4f24-a528-7132f72f955e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:12.300903 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce154b8d-8b98-4f24-a528-7132f72f955e None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:12.312423 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 235/462] 10.222.0.18 () {56 vars in 1109 bytes} [Thu Oct 13 10:58:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 10:58:12.313229 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce154b8d-8b98-4f24-a528-7132f72f955e None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:12.353148 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:58:12.397929 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a2a795-4be5-4d8c-97bc-8d639e6e1450 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:12.419109 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce154b8d-8b98-4f24-a528-7132f72f955e None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:12.432734 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091f35b4-dcd4-4972-bc87-110ac78034ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:12.433408 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091f35b4-dcd4-4972-bc87-110ac78034ac None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:12.433682 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091f35b4-dcd4-4972-bc87-110ac78034ac None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:12.433948 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091f35b4-dcd4-4972-bc87-110ac78034ac None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:12.444705 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091f35b4-dcd4-4972-bc87-110ac78034ac None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:12.446707 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091f35b4-dcd4-4972-bc87-110ac78034ac None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:12.454823 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38f2353-d9d4-40c6-a068-cd507ef5179e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:12.455507 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38f2353-d9d4-40c6-a068-cd507ef5179e None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:12.455911 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38f2353-d9d4-40c6-a068-cd507ef5179e None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:12.456250 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38f2353-d9d4-40c6-a068-cd507ef5179e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:12.461078 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application [None req-091f35b4-dcd4-4972-bc87-110ac78034ac None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 13 10:58:12.461078 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 10:58:12.461078 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 10:58:12.461078 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 10:58:12.461078 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 10:58:12.461078 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 10:58:12.461078 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 10:58:12.461078 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 10:58:12.461078 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 10:58:12.461078 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 10:58:12.461078 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 10:58:12.461078 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 10:58:12.461078 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 13 10:58:12.461078 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 13 10:58:12.461078 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 13 10:58:12.461078 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 13 10:58:12.462187 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 10:58:12.462187 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 10:58:12.462187 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 10:58:12.462187 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 10:58:12.462187 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 10:58:12.462187 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 10:58:12.462187 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 10:58:12.462187 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application with Lock( Oct 13 10:58:12.462187 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 10:58:12.462187 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._enter() Oct 13 10:58:12.462187 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 10:58:12.462187 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 10:58:12.462187 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 10:58:12.462187 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.creator() Oct 13 10:58:12.462187 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 10:58:12.462187 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application created_value = creator( Oct 13 10:58:12.462187 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 13 10:58:12.463275 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 13 10:58:12.463275 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 13 10:58:12.463275 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application Oct 13 10:58:12.468295 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 228/463] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Oct 13 10:58:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 10:58:12.468295 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091f35b4-dcd4-4972-bc87-110ac78034ac None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:12.472363 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38f2353-d9d4-40c6-a068-cd507ef5179e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:12.473956 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38f2353-d9d4-40c6-a068-cd507ef5179e None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:12.488821 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application [None req-f38f2353-d9d4-40c6-a068-cd507ef5179e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 13 10:58:12.488821 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 10:58:12.488821 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 10:58:12.488821 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 10:58:12.488821 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 10:58:12.488821 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 10:58:12.488821 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 10:58:12.488821 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 10:58:12.488821 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 10:58:12.488821 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 10:58:12.488821 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 10:58:12.488821 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 10:58:12.488821 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 13 10:58:12.488821 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 13 10:58:12.488821 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 13 10:58:12.488821 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 13 10:58:12.489998 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 10:58:12.489998 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 10:58:12.489998 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 10:58:12.489998 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 10:58:12.489998 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 10:58:12.489998 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 10:58:12.489998 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 10:58:12.489998 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application with Lock( Oct 13 10:58:12.489998 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 10:58:12.489998 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._enter() Oct 13 10:58:12.489998 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 10:58:12.489998 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 10:58:12.489998 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 10:58:12.489998 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.creator() Oct 13 10:58:12.489998 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 10:58:12.489998 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application created_value = creator( Oct 13 10:58:12.489998 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 13 10:58:12.491054 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 13 10:58:12.491054 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 13 10:58:12.491054 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application Oct 13 10:58:12.496592 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 236/464] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Oct 13 10:58:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 10:58:12.496592 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38f2353-d9d4-40c6-a068-cd507ef5179e None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:12.544458 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:58:12.582036 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091f35b4-dcd4-4972-bc87-110ac78034ac None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:12.595868 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:58:12.601585 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38f2353-d9d4-40c6-a068-cd507ef5179e None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:12.620979 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4adbf06-9e80-4205-845d-0f694780e058 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:12.621800 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4adbf06-9e80-4205-845d-0f694780e058 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:12.622136 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4adbf06-9e80-4205-845d-0f694780e058 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:12.622469 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4adbf06-9e80-4205-845d-0f694780e058 None admin] PATH_INFO: `/v3/users` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:12.623262 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4adbf06-9e80-4205-845d-0f694780e058 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 10:58:12.623631 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4adbf06-9e80-4205-845d-0f694780e058 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:12.625372 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4adbf06-9e80-4205-845d-0f694780e058 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:12.636128 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ea71e2-fa21-4d88-baa0-cda061c2f2cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:12.636837 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ea71e2-fa21-4d88-baa0-cda061c2f2cf None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:12.637209 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ea71e2-fa21-4d88-baa0-cda061c2f2cf None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:12.637552 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ea71e2-fa21-4d88-baa0-cda061c2f2cf None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:12.644948 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ea71e2-fa21-4d88-baa0-cda061c2f2cf None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:12.645372 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 229/465] 10.222.0.18 () {56 vars in 1137 bytes} [Thu Oct 13 10:58:12 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 10:58:12.646256 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4adbf06-9e80-4205-845d-0f694780e058 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:12.651067 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ea71e2-fa21-4d88-baa0-cda061c2f2cf None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:12.662446 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application [None req-f4ea71e2-fa21-4d88-baa0-cda061c2f2cf None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Oct 13 10:58:12.662446 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 10:58:12.662446 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 10:58:12.662446 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 10:58:12.662446 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 10:58:12.662446 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 10:58:12.662446 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 10:58:12.662446 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 10:58:12.662446 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 10:58:12.662446 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 10:58:12.662446 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 10:58:12.662446 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 10:58:12.662446 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 13 10:58:12.662446 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 13 10:58:12.662446 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 13 10:58:12.662446 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 13 10:58:12.663362 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 10:58:12.663362 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 10:58:12.663362 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 13 10:58:12.663362 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 13 10:58:12.663362 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 13 10:58:12.663362 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 13 10:58:12.663362 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 10:58:12.663362 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 10:58:12.663362 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 10:58:12.663362 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 10:58:12.663362 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 10:58:12.663362 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application with Lock( Oct 13 10:58:12.663362 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 10:58:12.663362 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._enter() Oct 13 10:58:12.663362 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 10:58:12.663362 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 10:58:12.663362 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 10:58:12.663362 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.creator() Oct 13 10:58:12.664614 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 10:58:12.664614 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application created_value = creator( Oct 13 10:58:12.664614 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 13 10:58:12.664614 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 13 10:58:12.664614 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 13 10:58:12.664614 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 13 10:58:12.664614 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 13 10:58:12.664614 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 13 10:58:12.664614 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Oct 13 10:58:12.664614 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application Oct 13 10:58:12.664614 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 237/466] 10.222.0.18 () {56 vars in 1102 bytes} [Thu Oct 13 10:58:12 2022] GET /identity/v3/users/neutron => generated 85 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 10:58:12.664614 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ea71e2-fa21-4d88-baa0-cda061c2f2cf None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:12.764732 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4adbf06-9e80-4205-845d-0f694780e058 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:12.769543 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ea71e2-fa21-4d88-baa0-cda061c2f2cf None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:12.771866 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:58:12.799724 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7580d1c-a063-4aab-a84d-e976c06c4cd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:12.800346 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7580d1c-a063-4aab-a84d-e976c06c4cd0 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:12.800681 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7580d1c-a063-4aab-a84d-e976c06c4cd0 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:12.801033 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7580d1c-a063-4aab-a84d-e976c06c4cd0 None admin] PATH_INFO: `/v3/domains` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:12.801748 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7580d1c-a063-4aab-a84d-e976c06c4cd0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 10:58:12.802146 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7580d1c-a063-4aab-a84d-e976c06c4cd0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:12.803777 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7580d1c-a063-4aab-a84d-e976c06c4cd0 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:12.807605 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46fdeaf6-02cc-4dbd-b2e7-7cf8354ad9dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:12.808277 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fdeaf6-02cc-4dbd-b2e7-7cf8354ad9dd None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:12.808626 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fdeaf6-02cc-4dbd-b2e7-7cf8354ad9dd None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:12.808963 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fdeaf6-02cc-4dbd-b2e7-7cf8354ad9dd None admin] PATH_INFO: `/v3/domains` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:12.809692 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46fdeaf6-02cc-4dbd-b2e7-7cf8354ad9dd None admin] RBAC: Adding query filter params (name=Default) {{(pid=81533) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 10:58:12.810065 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46fdeaf6-02cc-4dbd-b2e7-7cf8354ad9dd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:12.811504 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46fdeaf6-02cc-4dbd-b2e7-7cf8354ad9dd None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:12.821958 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 230/467] 10.222.0.18 () {56 vars in 1109 bytes} [Thu Oct 13 10:58:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 10:58:12.821958 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7580d1c-a063-4aab-a84d-e976c06c4cd0 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:12.827533 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 238/468] 10.222.0.18 () {56 vars in 1109 bytes} [Thu Oct 13 10:58:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 10:58:12.831901 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46fdeaf6-02cc-4dbd-b2e7-7cf8354ad9dd None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:12.856358 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:58:12.935444 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7580d1c-a063-4aab-a84d-e976c06c4cd0 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:12.936074 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46fdeaf6-02cc-4dbd-b2e7-7cf8354ad9dd None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:12.969632 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b87ddf2-264e-4ac0-a39b-f26391c20ae4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:12.970410 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b87ddf2-264e-4ac0-a39b-f26391c20ae4 None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:12.970785 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b87ddf2-264e-4ac0-a39b-f26391c20ae4 None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:12.971154 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b87ddf2-264e-4ac0-a39b-f26391c20ae4 None admin] PATH_INFO: `/v3/users` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:12.971342 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2637e6e-1a6f-4804-aabe-7f1886789541 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:12.971946 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2637e6e-1a6f-4804-aabe-7f1886789541 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:12.972148 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b87ddf2-264e-4ac0-a39b-f26391c20ae4 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81533) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 10:58:12.972240 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2637e6e-1a6f-4804-aabe-7f1886789541 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:12.972486 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2637e6e-1a6f-4804-aabe-7f1886789541 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:12.972713 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b87ddf2-264e-4ac0-a39b-f26391c20ae4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:12.974282 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b87ddf2-264e-4ac0-a39b-f26391c20ae4 None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:12.996429 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 239/469] 10.222.0.18 () {56 vars in 1139 bytes} [Thu Oct 13 10:58:12 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 10:58:12.996429 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b87ddf2-264e-4ac0-a39b-f26391c20ae4 None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:13.018189 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:58:13.054824 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2637e6e-1a6f-4804-aabe-7f1886789541 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:13.056544 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2637e6e-1a6f-4804-aabe-7f1886789541 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:13.088299 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:58:13.093920 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b87ddf2-264e-4ac0-a39b-f26391c20ae4 None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:13.127593 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e8fc0d-3db3-4d09-8c2b-8a59e73a6f1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:13.128311 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e8fc0d-3db3-4d09-8c2b-8a59e73a6f1d None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:13.128667 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e8fc0d-3db3-4d09-8c2b-8a59e73a6f1d None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:13.129043 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e8fc0d-3db3-4d09-8c2b-8a59e73a6f1d None admin] PATH_INFO: `/v3/projects/service` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:13.136675 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e8fc0d-3db3-4d09-8c2b-8a59e73a6f1d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:13.138233 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e8fc0d-3db3-4d09-8c2b-8a59e73a6f1d None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:13.149380 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application [None req-20e8fc0d-3db3-4d09-8c2b-8a59e73a6f1d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 13 10:58:13.149380 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 10:58:13.149380 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 10:58:13.149380 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 10:58:13.149380 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 10:58:13.149380 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 10:58:13.149380 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 10:58:13.149380 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 10:58:13.149380 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 10:58:13.149380 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 10:58:13.149380 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 10:58:13.149380 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 10:58:13.149380 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 13 10:58:13.149380 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 13 10:58:13.149380 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 13 10:58:13.150442 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 13 10:58:13.150442 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 10:58:13.150442 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 10:58:13.150442 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 10:58:13.150442 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 10:58:13.150442 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 10:58:13.150442 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 10:58:13.150442 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 10:58:13.150442 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application with Lock( Oct 13 10:58:13.150442 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 10:58:13.150442 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._enter() Oct 13 10:58:13.150442 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 10:58:13.150442 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 10:58:13.150442 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 10:58:13.150442 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.creator() Oct 13 10:58:13.150442 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 10:58:13.150442 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application created_value = creator( Oct 13 10:58:13.151526 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 13 10:58:13.151526 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 13 10:58:13.151526 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 13 10:58:13.151526 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 13 10:58:13.151526 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 13 10:58:13.151526 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 13 10:58:13.151526 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 13 10:58:13.151526 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application Oct 13 10:58:13.152751 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 240/470] 10.222.0.18 () {56 vars in 1111 bytes} [Thu Oct 13 10:58:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 10:58:13.153618 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e8fc0d-3db3-4d09-8c2b-8a59e73a6f1d None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:13.175388 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 231/471] 10.222.0.18 () {58 vars in 1282 bytes} [Thu Oct 13 10:58:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 13 10:58:13.175388 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2637e6e-1a6f-4804-aabe-7f1886789541 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:13.248592 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:58:13.270564 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e8fc0d-3db3-4d09-8c2b-8a59e73a6f1d None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:13.277994 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2637e6e-1a6f-4804-aabe-7f1886789541 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:13.306804 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b32e804-4aee-4ea3-ba92-6d3872bd06e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:13.307347 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b32e804-4aee-4ea3-ba92-6d3872bd06e8 None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:13.307679 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b32e804-4aee-4ea3-ba92-6d3872bd06e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:13.307894 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b32e804-4aee-4ea3-ba92-6d3872bd06e8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:13.308665 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:58:13.314251 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40fccd82-efec-4e03-af7f-acedb18d6dd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:13.314901 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fccd82-efec-4e03-af7f-acedb18d6dd6 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:13.315131 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fccd82-efec-4e03-af7f-acedb18d6dd6 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:13.315402 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fccd82-efec-4e03-af7f-acedb18d6dd6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:13.315497 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b32e804-4aee-4ea3-ba92-6d3872bd06e8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:13.316941 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b32e804-4aee-4ea3-ba92-6d3872bd06e8 None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:13.331470 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application [None req-1b32e804-4aee-4ea3-ba92-6d3872bd06e8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 13 10:58:13.331470 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 10:58:13.331470 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 10:58:13.331470 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 10:58:13.331470 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 10:58:13.331470 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 10:58:13.331470 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 10:58:13.331470 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 10:58:13.331470 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 10:58:13.331470 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 10:58:13.331470 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 10:58:13.331470 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 10:58:13.331470 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 13 10:58:13.331470 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 13 10:58:13.331470 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 13 10:58:13.332408 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 13 10:58:13.332408 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 10:58:13.332408 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 10:58:13.332408 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 10:58:13.332408 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 10:58:13.332408 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 10:58:13.332408 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 10:58:13.332408 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 10:58:13.332408 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application with Lock( Oct 13 10:58:13.332408 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 10:58:13.332408 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._enter() Oct 13 10:58:13.332408 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 10:58:13.332408 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 10:58:13.332408 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 10:58:13.332408 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.creator() Oct 13 10:58:13.332408 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 10:58:13.332408 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application created_value = creator( Oct 13 10:58:13.333335 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 13 10:58:13.333335 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 13 10:58:13.333335 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 13 10:58:13.333335 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 13 10:58:13.333335 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 13 10:58:13.333335 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 13 10:58:13.333335 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 13 10:58:13.333335 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application Oct 13 10:58:13.338192 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 241/472] 10.222.0.18 () {56 vars in 1111 bytes} [Thu Oct 13 10:58:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 10:58:13.339168 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b32e804-4aee-4ea3-ba92-6d3872bd06e8 None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:13.396175 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40fccd82-efec-4e03-af7f-acedb18d6dd6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:13.397944 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40fccd82-efec-4e03-af7f-acedb18d6dd6 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:13.446235 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b32e804-4aee-4ea3-ba92-6d3872bd06e8 None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:13.479824 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7c6ae7-cadf-4507-b7e4-147b5d049199 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:13.480522 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7c6ae7-cadf-4507-b7e4-147b5d049199 None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:13.480799 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7c6ae7-cadf-4507-b7e4-147b5d049199 None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:13.481093 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7c6ae7-cadf-4507-b7e4-147b5d049199 None admin] PATH_INFO: `/v3/projects` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:13.481777 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7c6ae7-cadf-4507-b7e4-147b5d049199 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81533) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 10:58:13.482077 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7c6ae7-cadf-4507-b7e4-147b5d049199 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:13.483511 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7c6ae7-cadf-4507-b7e4-147b5d049199 None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:13.495819 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 242/473] 10.222.0.18 () {56 vars in 1148 bytes} [Thu Oct 13 10:58:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 10:58:13.496594 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7c6ae7-cadf-4507-b7e4-147b5d049199 None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:13.499033 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:58:13.505235 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 232/474] 10.222.0.18 () {58 vars in 1282 bytes} [Thu Oct 13 10:58:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 13 10:58:13.506094 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40fccd82-efec-4e03-af7f-acedb18d6dd6 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:13.535061 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:58:13.596863 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7c6ae7-cadf-4507-b7e4-147b5d049199 None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:13.603891 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40fccd82-efec-4e03-af7f-acedb18d6dd6 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:13.630223 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c2df9e-5fb7-4a2c-9289-c2fa63d51eca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:13.630844 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c2df9e-5fb7-4a2c-9289-c2fa63d51eca None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:13.631124 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c2df9e-5fb7-4a2c-9289-c2fa63d51eca None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:13.631653 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c2df9e-5fb7-4a2c-9289-c2fa63d51eca None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:13.637057 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5aa435-e26f-4aaf-ae6a-3242daf0f9cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:13.637646 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5aa435-e26f-4aaf-ae6a-3242daf0f9cd None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:13.637919 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5aa435-e26f-4aaf-ae6a-3242daf0f9cd None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:13.638192 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5aa435-e26f-4aaf-ae6a-3242daf0f9cd None admin] PATH_INFO: `/v3/projects` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:13.638864 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5aa435-e26f-4aaf-ae6a-3242daf0f9cd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 10:58:13.639161 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5aa435-e26f-4aaf-ae6a-3242daf0f9cd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:13.640621 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5aa435-e26f-4aaf-ae6a-3242daf0f9cd None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:13.641639 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c2df9e-5fb7-4a2c-9289-c2fa63d51eca None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:13.643077 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c2df9e-5fb7-4a2c-9289-c2fa63d51eca None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:13.652163 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 233/475] 10.222.0.18 () {56 vars in 1148 bytes} [Thu Oct 13 10:58:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 10:58:13.653347 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5e3a98-624c-43f7-9f62-40e5c8a98247 None None] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:13.653625 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5e3a98-624c-43f7-9f62-40e5c8a98247 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:13.653892 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5e3a98-624c-43f7-9f62-40e5c8a98247 None None] PATH_INFO: `/` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:13.655219 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 234/476] 10.222.0.18 () {54 vars in 927 bytes} [Thu Oct 13 10:58:13 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 10:58:13.657885 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application [None req-c5c2df9e-5fb7-4a2c-9289-c2fa63d51eca None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 13 10:58:13.657885 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 10:58:13.657885 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 10:58:13.657885 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 10:58:13.657885 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 10:58:13.657885 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 10:58:13.657885 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 10:58:13.657885 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 10:58:13.657885 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 10:58:13.657885 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 10:58:13.657885 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 10:58:13.657885 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 10:58:13.657885 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 13 10:58:13.657885 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 13 10:58:13.657885 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 13 10:58:13.657885 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 13 10:58:13.658951 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 10:58:13.658951 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 10:58:13.658951 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 10:58:13.658951 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 10:58:13.658951 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 10:58:13.658951 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 10:58:13.658951 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 10:58:13.658951 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application with Lock( Oct 13 10:58:13.658951 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 10:58:13.658951 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._enter() Oct 13 10:58:13.658951 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 10:58:13.658951 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 10:58:13.658951 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 10:58:13.658951 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.creator() Oct 13 10:58:13.658951 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 10:58:13.658951 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application created_value = creator( Oct 13 10:58:13.658951 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 13 10:58:13.664835 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 13 10:58:13.664835 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 13 10:58:13.664835 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application Oct 13 10:58:13.664835 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 243/477] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Oct 13 10:58:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 10:58:13.665146 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5e3a98-624c-43f7-9f62-40e5c8a98247 None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:13.665230 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c2df9e-5fb7-4a2c-9289-c2fa63d51eca None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:13.716630 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:58:13.750177 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:58:13.762317 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5e3a98-624c-43f7-9f62-40e5c8a98247 None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:13.765508 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c2df9e-5fb7-4a2c-9289-c2fa63d51eca None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:13.795782 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920de06a-27c5-41e1-aaee-0601ddfd714f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:13.796389 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920de06a-27c5-41e1-aaee-0601ddfd714f None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:13.796669 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920de06a-27c5-41e1-aaee-0601ddfd714f None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:13.796942 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920de06a-27c5-41e1-aaee-0601ddfd714f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:13.797702 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920de06a-27c5-41e1-aaee-0601ddfd714f None admin] RBAC: Adding query filter params (role.id=6af7358ee6934ea2830749333f35aa5c, scope.project.id=112613528384453abe7506465609fbd8, user.id=5bd577557f564e148ebd1dcde1e8580b) {{(pid=81534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 10:58:13.798010 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920de06a-27c5-41e1-aaee-0601ddfd714f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:13.798743 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25ae124-2623-4703-9d8e-e897adb2c08f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:13.799362 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25ae124-2623-4703-9d8e-e897adb2c08f None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:13.799451 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920de06a-27c5-41e1-aaee-0601ddfd714f None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:13.799639 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25ae124-2623-4703-9d8e-e897adb2c08f None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:13.799912 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25ae124-2623-4703-9d8e-e897adb2c08f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:13.805638 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 235/478] 10.222.0.18 () {56 vars in 1374 bytes} [Thu Oct 13 10:58:13 2022] GET /identity/v3/role_assignments?user.id=5bd577557f564e148ebd1dcde1e8580b&scope.project.id=112613528384453abe7506465609fbd8&role.id=6af7358ee6934ea2830749333f35aa5c => generated 608 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 10:58:13.806427 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920de06a-27c5-41e1-aaee-0601ddfd714f None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:13.811182 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d25ae124-2623-4703-9d8e-e897adb2c08f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:13.813680 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d25ae124-2623-4703-9d8e-e897adb2c08f None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:13.830026 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application [None req-d25ae124-2623-4703-9d8e-e897adb2c08f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 13 10:58:13.830026 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 10:58:13.830026 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 10:58:13.830026 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 10:58:13.830026 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 10:58:13.830026 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 10:58:13.830026 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 10:58:13.830026 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 10:58:13.830026 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 10:58:13.830026 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 10:58:13.830026 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 10:58:13.830026 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 10:58:13.830026 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 13 10:58:13.830026 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 13 10:58:13.830026 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 13 10:58:13.830026 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 13 10:58:13.831024 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 10:58:13.831024 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 10:58:13.831024 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 10:58:13.831024 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 10:58:13.831024 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 10:58:13.831024 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 10:58:13.831024 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 10:58:13.831024 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application with Lock( Oct 13 10:58:13.831024 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 10:58:13.831024 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._enter() Oct 13 10:58:13.831024 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 10:58:13.831024 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 10:58:13.831024 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 10:58:13.831024 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.creator() Oct 13 10:58:13.831024 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 10:58:13.831024 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application created_value = creator( Oct 13 10:58:13.831024 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 13 10:58:13.831884 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 13 10:58:13.831884 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 13 10:58:13.831884 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application Oct 13 10:58:13.831884 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 244/479] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Oct 13 10:58:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 10:58:13.833144 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5f3789-a0a4-4906-b145-a6bf2000091c None None] REQUEST_METHOD: `POST` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:13.833261 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5f3789-a0a4-4906-b145-a6bf2000091c None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:13.833494 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5f3789-a0a4-4906-b145-a6bf2000091c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:13.853972 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.auth.core [None req-5f5f3789-a0a4-4906-b145-a6bf2000091c None None] MFA Rules not processed for user `8ba31ade43694cf8bf28f7528a9ea179`. Rule list: `[]` (Enabled: `True`). {{(pid=81533) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 10:58:13.855117 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-5f5f3789-a0a4-4906-b145-a6bf2000091c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 10:58:13.934623 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920de06a-27c5-41e1-aaee-0601ddfd714f None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:13.937058 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 245/480] 10.222.0.18 () {58 vars in 1024 bytes} [Thu Oct 13 10:58:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 13 10:58:13.937210 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5f3789-a0a4-4906-b145-a6bf2000091c None None] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:13.986870 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac06f2a3-2f1e-4bb6-8f9b-c54e1d095668 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:13.987474 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac06f2a3-2f1e-4bb6-8f9b-c54e1d095668 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:13.987754 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac06f2a3-2f1e-4bb6-8f9b-c54e1d095668 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:13.988021 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac06f2a3-2f1e-4bb6-8f9b-c54e1d095668 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:13.988744 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac06f2a3-2f1e-4bb6-8f9b-c54e1d095668 None admin] RBAC: Adding query filter params (role.id=6af7358ee6934ea2830749333f35aa5c, scope.project.id=112613528384453abe7506465609fbd8, user.id=bc5b13f97c0e4a31940b5b73a916af29) {{(pid=81534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 10:58:13.990739 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac06f2a3-2f1e-4bb6-8f9b-c54e1d095668 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:13.990739 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac06f2a3-2f1e-4bb6-8f9b-c54e1d095668 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:13.993370 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:58:13.999721 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 236/481] 10.222.0.18 () {56 vars in 1374 bytes} [Thu Oct 13 10:58:13 2022] GET /identity/v3/role_assignments?user.id=bc5b13f97c0e4a31940b5b73a916af29&scope.project.id=112613528384453abe7506465609fbd8&role.id=6af7358ee6934ea2830749333f35aa5c => generated 608 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 10:58:14.000508 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac06f2a3-2f1e-4bb6-8f9b-c54e1d095668 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:14.027634 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:58:14.076175 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5f3789-a0a4-4906-b145-a6bf2000091c None None] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:14.119826 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e0af91-23c7-49c7-97df-ca84c398139d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:14.120732 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e0af91-23c7-49c7-97df-ca84c398139d None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:14.121235 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e0af91-23c7-49c7-97df-ca84c398139d None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:14.121699 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e0af91-23c7-49c7-97df-ca84c398139d None admin] PATH_INFO: `/v3/domains` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:14.122564 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e0af91-23c7-49c7-97df-ca84c398139d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81533) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 10:58:14.123005 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e0af91-23c7-49c7-97df-ca84c398139d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:14.124540 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e0af91-23c7-49c7-97df-ca84c398139d None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:14.125229 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac06f2a3-2f1e-4bb6-8f9b-c54e1d095668 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:14.139161 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 246/482] 10.222.0.18 () {56 vars in 1109 bytes} [Thu Oct 13 10:58:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 10:58:14.152446 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e0af91-23c7-49c7-97df-ca84c398139d None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:14.170661 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4d7ee0-c014-4a7a-b102-afbe0aa8db48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:14.171436 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4d7ee0-c014-4a7a-b102-afbe0aa8db48 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:14.172245 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4d7ee0-c014-4a7a-b102-afbe0aa8db48 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:14.172245 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4d7ee0-c014-4a7a-b102-afbe0aa8db48 None admin] PATH_INFO: `/v3/domains` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:14.173087 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee4d7ee0-c014-4a7a-b102-afbe0aa8db48 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 10:58:14.173445 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee4d7ee0-c014-4a7a-b102-afbe0aa8db48 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:14.175061 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee4d7ee0-c014-4a7a-b102-afbe0aa8db48 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:14.191284 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 237/483] 10.222.0.18 () {56 vars in 1109 bytes} [Thu Oct 13 10:58:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 10:58:14.198469 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4d7ee0-c014-4a7a-b102-afbe0aa8db48 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:14.263968 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:58:14.271351 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e0af91-23c7-49c7-97df-ca84c398139d None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:14.300065 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:58:14.313756 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e634915-f9b3-4bae-af88-d76dad8d1492 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:14.314898 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e634915-f9b3-4bae-af88-d76dad8d1492 None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:14.315317 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e634915-f9b3-4bae-af88-d76dad8d1492 None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:14.315888 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e634915-f9b3-4bae-af88-d76dad8d1492 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:14.325054 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e634915-f9b3-4bae-af88-d76dad8d1492 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:14.325569 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4d7ee0-c014-4a7a-b102-afbe0aa8db48 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:14.326888 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e634915-f9b3-4bae-af88-d76dad8d1492 None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:14.342087 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application [None req-0e634915-f9b3-4bae-af88-d76dad8d1492 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 13 10:58:14.342087 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 10:58:14.342087 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 10:58:14.342087 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 10:58:14.342087 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 10:58:14.342087 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 10:58:14.342087 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 10:58:14.342087 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 10:58:14.342087 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 10:58:14.342087 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 10:58:14.342087 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 10:58:14.342087 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 10:58:14.342087 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 13 10:58:14.342087 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 13 10:58:14.342087 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 13 10:58:14.343252 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 13 10:58:14.343252 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 10:58:14.343252 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 10:58:14.343252 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 10:58:14.343252 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 10:58:14.343252 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 10:58:14.343252 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 10:58:14.343252 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 10:58:14.343252 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application with Lock( Oct 13 10:58:14.343252 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 10:58:14.343252 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._enter() Oct 13 10:58:14.343252 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 10:58:14.343252 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 10:58:14.343252 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 10:58:14.343252 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.creator() Oct 13 10:58:14.343252 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 10:58:14.343252 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application created_value = creator( Oct 13 10:58:14.344303 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 13 10:58:14.344303 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 13 10:58:14.344303 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 13 10:58:14.344303 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 13 10:58:14.344303 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 13 10:58:14.344303 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 13 10:58:14.344303 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 13 10:58:14.344303 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application Oct 13 10:58:14.350931 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 247/484] 10.222.0.18 () {56 vars in 1111 bytes} [Thu Oct 13 10:58:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 13 10:58:14.350931 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e634915-f9b3-4bae-af88-d76dad8d1492 None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:14.373616 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20c1947-de47-48e1-b716-9b2c2a0388c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:14.374180 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20c1947-de47-48e1-b716-9b2c2a0388c0 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:14.374603 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20c1947-de47-48e1-b716-9b2c2a0388c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:14.375015 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20c1947-de47-48e1-b716-9b2c2a0388c0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:14.382820 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20c1947-de47-48e1-b716-9b2c2a0388c0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:14.384597 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20c1947-de47-48e1-b716-9b2c2a0388c0 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:14.399034 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application [None req-a20c1947-de47-48e1-b716-9b2c2a0388c0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 13 10:58:14.399034 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 10:58:14.399034 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 10:58:14.399034 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 10:58:14.399034 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 10:58:14.399034 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 10:58:14.399034 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 10:58:14.399034 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 10:58:14.399034 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 10:58:14.399034 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 10:58:14.399034 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 10:58:14.399034 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 10:58:14.399034 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 13 10:58:14.399034 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 13 10:58:14.399034 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 13 10:58:14.400044 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 13 10:58:14.400044 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 10:58:14.400044 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 10:58:14.400044 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 10:58:14.400044 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 10:58:14.400044 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 10:58:14.400044 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 10:58:14.400044 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 10:58:14.400044 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application with Lock( Oct 13 10:58:14.400044 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 10:58:14.400044 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._enter() Oct 13 10:58:14.400044 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 10:58:14.400044 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 10:58:14.400044 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 10:58:14.400044 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.creator() Oct 13 10:58:14.400044 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 10:58:14.400044 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application created_value = creator( Oct 13 10:58:14.400972 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 13 10:58:14.400972 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 13 10:58:14.400972 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 13 10:58:14.400972 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 13 10:58:14.400972 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 13 10:58:14.400972 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 13 10:58:14.400972 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 13 10:58:14.400972 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application Oct 13 10:58:14.400972 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 238/485] 10.222.0.18 () {56 vars in 1111 bytes} [Thu Oct 13 10:58:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 10:58:14.401468 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20c1947-de47-48e1-b716-9b2c2a0388c0 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:14.484508 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e634915-f9b3-4bae-af88-d76dad8d1492 None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:14.522779 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20c1947-de47-48e1-b716-9b2c2a0388c0 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:14.527994 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63998d0-29c3-4954-a3ea-34a9f58a7396 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:14.528837 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63998d0-29c3-4954-a3ea-34a9f58a7396 None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:14.529319 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63998d0-29c3-4954-a3ea-34a9f58a7396 None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:14.529789 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63998d0-29c3-4954-a3ea-34a9f58a7396 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:14.542050 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63998d0-29c3-4954-a3ea-34a9f58a7396 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 13 10:58:14.547770 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application [None req-c63998d0-29c3-4954-a3ea-34a9f58a7396 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 13 10:58:14.547770 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 10:58:14.547770 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 10:58:14.547770 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 10:58:14.547770 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 10:58:14.547770 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 10:58:14.547770 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 10:58:14.547770 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 10:58:14.547770 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 10:58:14.547770 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 10:58:14.547770 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 10:58:14.547770 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 10:58:14.547770 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 13 10:58:14.547770 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 13 10:58:14.547770 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 13 10:58:14.547770 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 13 10:58:14.548665 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 13 10:58:14.548665 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 13 10:58:14.548665 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 13 10:58:14.548665 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 13 10:58:14.548665 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 10:58:14.548665 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 10:58:14.548665 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 10:58:14.548665 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 10:58:14.548665 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 10:58:14.548665 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 10:58:14.548665 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 10:58:14.548665 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application with Lock( Oct 13 10:58:14.548665 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 10:58:14.548665 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._enter() Oct 13 10:58:14.548665 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 10:58:14.548665 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 10:58:14.549507 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 10:58:14.549507 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.creator() Oct 13 10:58:14.549507 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 10:58:14.549507 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application created_value = creator( Oct 13 10:58:14.549507 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 13 10:58:14.549507 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 13 10:58:14.549507 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 13 10:58:14.549507 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 13 10:58:14.549507 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 13 10:58:14.549507 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 13 10:58:14.549507 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 13 10:58:14.549507 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application Oct 13 10:58:14.552481 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 248/486] 10.222.0.18 () {56 vars in 1102 bytes} [Thu Oct 13 10:58:14 2022] GET /identity/v3/roles/service => generated 85 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 10:58:14.553568 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63998d0-29c3-4954-a3ea-34a9f58a7396 None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:14.565158 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20278947-b7f8-46c8-a93d-053d67d76b68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:14.565875 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20278947-b7f8-46c8-a93d-053d67d76b68 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:14.566054 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20278947-b7f8-46c8-a93d-053d67d76b68 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:14.566315 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20278947-b7f8-46c8-a93d-053d67d76b68 None admin] PATH_INFO: `/v3/projects` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:14.567006 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20278947-b7f8-46c8-a93d-053d67d76b68 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 10:58:14.567311 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20278947-b7f8-46c8-a93d-053d67d76b68 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:14.568786 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20278947-b7f8-46c8-a93d-053d67d76b68 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:14.575236 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:58:14.576573 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:58:14.583195 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 239/487] 10.222.0.18 () {56 vars in 1148 bytes} [Thu Oct 13 10:58:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 10:58:14.584447 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20278947-b7f8-46c8-a93d-053d67d76b68 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:14.676733 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63998d0-29c3-4954-a3ea-34a9f58a7396 None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:14.707146 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20278947-b7f8-46c8-a93d-053d67d76b68 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:14.721372 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4581cd-0543-4dd9-b1d5-1448f64a3179 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:14.721985 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4581cd-0543-4dd9-b1d5-1448f64a3179 None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:14.722266 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4581cd-0543-4dd9-b1d5-1448f64a3179 None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:14.722542 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4581cd-0543-4dd9-b1d5-1448f64a3179 None admin] PATH_INFO: `/v3/projects` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:14.723404 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4581cd-0543-4dd9-b1d5-1448f64a3179 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81533) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 10:58:14.723761 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4581cd-0543-4dd9-b1d5-1448f64a3179 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:14.725923 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4581cd-0543-4dd9-b1d5-1448f64a3179 None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:14.752074 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 249/488] 10.222.0.18 () {56 vars in 1148 bytes} [Thu Oct 13 10:58:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 10:58:14.752074 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4581cd-0543-4dd9-b1d5-1448f64a3179 None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:14.761626 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b526fc03-a66c-45b0-8b48-e37452dca71c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:14.762637 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b526fc03-a66c-45b0-8b48-e37452dca71c None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:14.763136 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b526fc03-a66c-45b0-8b48-e37452dca71c None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:14.763603 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b526fc03-a66c-45b0-8b48-e37452dca71c None admin] PATH_INFO: `/v3/roles` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:14.764519 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b526fc03-a66c-45b0-8b48-e37452dca71c None admin] RBAC: Adding query filter params (name=service) {{(pid=81534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 10:58:14.765043 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b526fc03-a66c-45b0-8b48-e37452dca71c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:14.766654 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b526fc03-a66c-45b0-8b48-e37452dca71c None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:14.776197 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 240/489] 10.222.0.18 () {56 vars in 1103 bytes} [Thu Oct 13 10:58:14 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 10:58:14.777577 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b526fc03-a66c-45b0-8b48-e37452dca71c None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:14.842211 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:58:14.846294 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:58:14.877823 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4581cd-0543-4dd9-b1d5-1448f64a3179 None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:14.891609 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b526fc03-a66c-45b0-8b48-e37452dca71c None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:14.924222 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c564161-d9a9-45a5-805e-269522665899 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:14.925105 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c564161-d9a9-45a5-805e-269522665899 None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:14.925436 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c564161-d9a9-45a5-805e-269522665899 None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:14.925717 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c564161-d9a9-45a5-805e-269522665899 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:14.926449 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c564161-d9a9-45a5-805e-269522665899 None admin] RBAC: Adding query filter params (role.id=6af7358ee6934ea2830749333f35aa5c, scope.project.id=112613528384453abe7506465609fbd8, user.id=85a35c31fd1340f79ac67a10b4963b44) {{(pid=81533) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 10:58:14.926968 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c564161-d9a9-45a5-805e-269522665899 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:14.928962 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c564161-d9a9-45a5-805e-269522665899 None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:14.933954 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98505c3-db50-407d-b296-96ccaebb1204 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:14.934858 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98505c3-db50-407d-b296-96ccaebb1204 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:14.935332 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98505c3-db50-407d-b296-96ccaebb1204 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:14.935819 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98505c3-db50-407d-b296-96ccaebb1204 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:14.936387 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 250/490] 10.222.0.18 () {56 vars in 1374 bytes} [Thu Oct 13 10:58:14 2022] GET /identity/v3/role_assignments?user.id=85a35c31fd1340f79ac67a10b4963b44&scope.project.id=112613528384453abe7506465609fbd8&role.id=6af7358ee6934ea2830749333f35aa5c => generated 608 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 10:58:14.936999 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c564161-d9a9-45a5-805e-269522665899 None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:14.937585 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98505c3-db50-407d-b296-96ccaebb1204 None admin] RBAC: Adding query filter params (role.id=6af7358ee6934ea2830749333f35aa5c, scope.project.id=112613528384453abe7506465609fbd8, user.id=6d31effc2bc44d698b5adb5254263dc5) {{(pid=81534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 10:58:14.938091 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98505c3-db50-407d-b296-96ccaebb1204 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:14.939941 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98505c3-db50-407d-b296-96ccaebb1204 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:14.953195 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 241/491] 10.222.0.18 () {56 vars in 1374 bytes} [Thu Oct 13 10:58:14 2022] GET /identity/v3/role_assignments?user.id=6d31effc2bc44d698b5adb5254263dc5&scope.project.id=112613528384453abe7506465609fbd8&role.id=6af7358ee6934ea2830749333f35aa5c => generated 608 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 10:58:15.056711 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c564161-d9a9-45a5-805e-269522665899 None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:15.094926 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35aab9c7-fc31-40ba-a6b2-149b3aeea7a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:15.095588 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35aab9c7-fc31-40ba-a6b2-149b3aeea7a6 None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:15.095867 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35aab9c7-fc31-40ba-a6b2-149b3aeea7a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:15.096140 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35aab9c7-fc31-40ba-a6b2-149b3aeea7a6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:15.109746 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35aab9c7-fc31-40ba-a6b2-149b3aeea7a6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:15.111282 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35aab9c7-fc31-40ba-a6b2-149b3aeea7a6 None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:15.128256 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application [None req-35aab9c7-fc31-40ba-a6b2-149b3aeea7a6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 13 10:58:15.128256 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 10:58:15.128256 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 10:58:15.128256 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 10:58:15.128256 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 10:58:15.128256 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 10:58:15.128256 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 10:58:15.128256 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 10:58:15.128256 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 10:58:15.128256 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 10:58:15.128256 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 10:58:15.128256 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 10:58:15.128256 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 13 10:58:15.128256 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 13 10:58:15.128256 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 13 10:58:15.128256 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 13 10:58:15.129266 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 10:58:15.129266 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 10:58:15.129266 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 10:58:15.129266 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 10:58:15.129266 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 10:58:15.129266 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 10:58:15.129266 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 10:58:15.129266 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application with Lock( Oct 13 10:58:15.129266 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 10:58:15.129266 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._enter() Oct 13 10:58:15.129266 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 10:58:15.129266 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 10:58:15.129266 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 10:58:15.129266 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.creator() Oct 13 10:58:15.129266 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 10:58:15.129266 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application created_value = creator( Oct 13 10:58:15.129266 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 13 10:58:15.131270 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 13 10:58:15.131270 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 13 10:58:15.131270 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application Oct 13 10:58:15.131270 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 251/492] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Oct 13 10:58:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 10:58:15.132192 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:58:15.135874 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98505c3-db50-407d-b296-96ccaebb1204 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:15.260343 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98505c3-db50-407d-b296-96ccaebb1204 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:15.285327 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:58:15.307235 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3bd3c4e-1a56-4648-a539-65bca5e6e667 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:15.309110 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bd3c4e-1a56-4648-a539-65bca5e6e667 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:15.309699 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bd3c4e-1a56-4648-a539-65bca5e6e667 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:15.309974 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bd3c4e-1a56-4648-a539-65bca5e6e667 None admin] PATH_INFO: `/v3/domains` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:15.310655 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3bd3c4e-1a56-4648-a539-65bca5e6e667 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 10:58:15.310964 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3bd3c4e-1a56-4648-a539-65bca5e6e667 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:15.312330 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3bd3c4e-1a56-4648-a539-65bca5e6e667 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:15.331181 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 242/493] 10.222.0.18 () {56 vars in 1109 bytes} [Thu Oct 13 10:58:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 10:58:15.336614 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35aab9c7-fc31-40ba-a6b2-149b3aeea7a6 None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:15.443461 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35aab9c7-fc31-40ba-a6b2-149b3aeea7a6 None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:15.484371 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2000c7e-6509-487b-90f8-01fc0d244fa9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:15.485034 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2000c7e-6509-487b-90f8-01fc0d244fa9 None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:15.485317 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2000c7e-6509-487b-90f8-01fc0d244fa9 None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:15.485588 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2000c7e-6509-487b-90f8-01fc0d244fa9 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:15.498168 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2000c7e-6509-487b-90f8-01fc0d244fa9 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:15.499932 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2000c7e-6509-487b-90f8-01fc0d244fa9 None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:15.516665 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application [None req-d2000c7e-6509-487b-90f8-01fc0d244fa9 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Oct 13 10:58:15.516665 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 10:58:15.516665 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 10:58:15.516665 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 10:58:15.516665 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 10:58:15.516665 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 10:58:15.516665 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 10:58:15.516665 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 10:58:15.516665 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 10:58:15.516665 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 10:58:15.516665 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 10:58:15.516665 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 10:58:15.516665 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 13 10:58:15.516665 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 13 10:58:15.516665 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 13 10:58:15.516665 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 13 10:58:15.517742 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 10:58:15.517742 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 10:58:15.517742 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 13 10:58:15.517742 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 13 10:58:15.517742 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 13 10:58:15.517742 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 13 10:58:15.517742 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 10:58:15.517742 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 10:58:15.517742 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 10:58:15.517742 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 10:58:15.517742 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 10:58:15.517742 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application with Lock( Oct 13 10:58:15.517742 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 10:58:15.517742 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._enter() Oct 13 10:58:15.517742 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 10:58:15.517742 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 10:58:15.517742 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 10:58:15.517742 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.creator() Oct 13 10:58:15.518912 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 10:58:15.518912 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application created_value = creator( Oct 13 10:58:15.518912 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 13 10:58:15.518912 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 13 10:58:15.518912 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 13 10:58:15.518912 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 13 10:58:15.518912 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 13 10:58:15.518912 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 13 10:58:15.518912 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Oct 13 10:58:15.518912 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application Oct 13 10:58:15.521129 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 252/494] 10.222.0.18 () {56 vars in 1096 bytes} [Thu Oct 13 10:58:15 2022] GET /identity/v3/users/swift => generated 83 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 10:58:15.530384 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3bd3c4e-1a56-4648-a539-65bca5e6e667 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:15.683781 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3bd3c4e-1a56-4648-a539-65bca5e6e667 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:15.733378 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c39d0b8-2695-4f03-a643-063048bee839 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:15.733983 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c39d0b8-2695-4f03-a643-063048bee839 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:15.734255 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c39d0b8-2695-4f03-a643-063048bee839 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:15.734520 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c39d0b8-2695-4f03-a643-063048bee839 None admin] PATH_INFO: `/v3/users` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:15.735244 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c39d0b8-2695-4f03-a643-063048bee839 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 10:58:15.735540 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c39d0b8-2695-4f03-a643-063048bee839 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:15.736974 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c39d0b8-2695-4f03-a643-063048bee839 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:15.764045 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 243/495] 10.222.0.18 () {56 vars in 1135 bytes} [Thu Oct 13 10:58:15 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 10:58:15.770000 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2000c7e-6509-487b-90f8-01fc0d244fa9 None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:15.837545 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:58:15.900605 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2000c7e-6509-487b-90f8-01fc0d244fa9 None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:15.940504 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e27a169-9ca3-4ecd-98d9-3a2f9f24ab3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:15.941145 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e27a169-9ca3-4ecd-98d9-3a2f9f24ab3f None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:15.941426 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e27a169-9ca3-4ecd-98d9-3a2f9f24ab3f None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:15.941698 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e27a169-9ca3-4ecd-98d9-3a2f9f24ab3f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:16.030471 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e27a169-9ca3-4ecd-98d9-3a2f9f24ab3f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:16.031850 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e27a169-9ca3-4ecd-98d9-3a2f9f24ab3f None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:16.105820 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:58:16.165046 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 253/496] 10.222.0.18 () {58 vars in 1282 bytes} [Thu Oct 13 10:58:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 395 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 13 10:58:16.174118 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c39d0b8-2695-4f03-a643-063048bee839 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:16.248565 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:58:16.323078 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c39d0b8-2695-4f03-a643-063048bee839 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:16.365404 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fe0aea-2cc1-46ad-9e3f-c458f35477f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:16.366370 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fe0aea-2cc1-46ad-9e3f-c458f35477f2 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:16.366855 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fe0aea-2cc1-46ad-9e3f-c458f35477f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:16.367891 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fe0aea-2cc1-46ad-9e3f-c458f35477f2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:16.385152 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96fe0aea-2cc1-46ad-9e3f-c458f35477f2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:16.386950 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96fe0aea-2cc1-46ad-9e3f-c458f35477f2 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:16.406653 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application [None req-96fe0aea-2cc1-46ad-9e3f-c458f35477f2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 13 10:58:16.406653 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 10:58:16.406653 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 10:58:16.406653 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 10:58:16.406653 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 10:58:16.406653 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 10:58:16.406653 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 10:58:16.406653 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 10:58:16.406653 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 10:58:16.406653 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 10:58:16.406653 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 10:58:16.406653 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 10:58:16.406653 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 13 10:58:16.406653 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 13 10:58:16.406653 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 13 10:58:16.406653 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 13 10:58:16.407784 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 10:58:16.407784 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 10:58:16.407784 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 10:58:16.407784 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 10:58:16.407784 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 10:58:16.407784 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 10:58:16.407784 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 10:58:16.407784 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application with Lock( Oct 13 10:58:16.407784 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 10:58:16.407784 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._enter() Oct 13 10:58:16.407784 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 10:58:16.407784 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 10:58:16.407784 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 10:58:16.407784 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.creator() Oct 13 10:58:16.407784 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 10:58:16.407784 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application created_value = creator( Oct 13 10:58:16.407784 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 13 10:58:16.408686 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 13 10:58:16.408686 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 13 10:58:16.408686 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application Oct 13 10:58:16.411110 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 244/497] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Oct 13 10:58:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 10:58:16.417517 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e27a169-9ca3-4ecd-98d9-3a2f9f24ab3f None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:16.564767 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e27a169-9ca3-4ecd-98d9-3a2f9f24ab3f None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:16.605700 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6de06f0-fd04-4c84-9227-35ef7811bda7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:16.606237 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6de06f0-fd04-4c84-9227-35ef7811bda7 None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:16.606514 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6de06f0-fd04-4c84-9227-35ef7811bda7 None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:16.606784 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6de06f0-fd04-4c84-9227-35ef7811bda7 None admin] PATH_INFO: `/v3/domains` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:16.607429 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6de06f0-fd04-4c84-9227-35ef7811bda7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81533) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 10:58:16.607728 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6de06f0-fd04-4c84-9227-35ef7811bda7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:16.609117 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6de06f0-fd04-4c84-9227-35ef7811bda7 None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:16.629886 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 254/498] 10.222.0.18 () {56 vars in 1109 bytes} [Thu Oct 13 10:58:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 10:58:16.636053 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fe0aea-2cc1-46ad-9e3f-c458f35477f2 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:16.643712 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741c2bb4-1a46-42cc-ad64-acf2d7d04fa6 None None] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:16.644001 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741c2bb4-1a46-42cc-ad64-acf2d7d04fa6 None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:16.644281 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741c2bb4-1a46-42cc-ad64-acf2d7d04fa6 None None] PATH_INFO: `/` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:16.645912 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 255/499] 10.222.0.18 () {54 vars in 927 bytes} [Thu Oct 13 10:58:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 13 10:58:16.657025 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf05e00-0d80-4136-8866-8a85f212a1b0 None None] REQUEST_METHOD: `POST` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:16.659691 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf05e00-0d80-4136-8866-8a85f212a1b0 None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:16.659971 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf05e00-0d80-4136-8866-8a85f212a1b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:16.680840 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.auth.core [None req-faf05e00-0d80-4136-8866-8a85f212a1b0 None None] MFA Rules not processed for user `8ba31ade43694cf8bf28f7528a9ea179`. Rule list: `[]` (Enabled: `True`). {{(pid=81533) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 10:58:16.682056 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-faf05e00-0d80-4136-8866-8a85f212a1b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 10:58:16.690233 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:58:16.768428 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 256/500] 10.222.0.18 () {58 vars in 1024 bytes} [Thu Oct 13 10:58:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 13 10:58:16.770040 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08b6a9d-41a5-49ec-be3a-43709cb2e848 None None] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:16.770469 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08b6a9d-41a5-49ec-be3a-43709cb2e848 None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:16.770891 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08b6a9d-41a5-49ec-be3a-43709cb2e848 None None] PATH_INFO: `/` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:16.776692 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 257/501] 10.222.0.18 () {54 vars in 927 bytes} [Thu Oct 13 10:58:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 10:58:16.778675 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b767938-b2ac-4720-90a8-9613a094491f None None] REQUEST_METHOD: `POST` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:16.779162 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b767938-b2ac-4720-90a8-9613a094491f None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:16.779580 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b767938-b2ac-4720-90a8-9613a094491f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:16.797236 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:58:16.801649 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.auth.core [None req-4b767938-b2ac-4720-90a8-9613a094491f None None] MFA Rules not processed for user `8ba31ade43694cf8bf28f7528a9ea179`. Rule list: `[]` (Enabled: `True`). {{(pid=81533) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 10:58:16.803038 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-4b767938-b2ac-4720-90a8-9613a094491f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 10:58:16.811791 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fe0aea-2cc1-46ad-9e3f-c458f35477f2 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:16.890764 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f926d55-d0d7-430f-bed0-e0ebb0bafbc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:16.891692 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f926d55-d0d7-430f-bed0-e0ebb0bafbc7 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:16.892130 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f926d55-d0d7-430f-bed0-e0ebb0bafbc7 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:16.892554 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f926d55-d0d7-430f-bed0-e0ebb0bafbc7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:16.906825 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f926d55-d0d7-430f-bed0-e0ebb0bafbc7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:16.908457 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f926d55-d0d7-430f-bed0-e0ebb0bafbc7 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:16.933472 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application [None req-1f926d55-d0d7-430f-bed0-e0ebb0bafbc7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 13 10:58:16.933472 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 10:58:16.933472 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 10:58:16.933472 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 10:58:16.933472 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 10:58:16.933472 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 10:58:16.933472 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 10:58:16.933472 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 10:58:16.933472 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 10:58:16.933472 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 10:58:16.933472 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 10:58:16.933472 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 10:58:16.933472 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 13 10:58:16.933472 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 13 10:58:16.933472 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 13 10:58:16.935075 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 13 10:58:16.935075 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 10:58:16.935075 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 10:58:16.935075 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 10:58:16.935075 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 10:58:16.935075 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 10:58:16.935075 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 10:58:16.935075 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 10:58:16.935075 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application with Lock( Oct 13 10:58:16.935075 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 10:58:16.935075 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._enter() Oct 13 10:58:16.935075 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 10:58:16.935075 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 10:58:16.935075 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 10:58:16.935075 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.creator() Oct 13 10:58:16.935075 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 10:58:16.935075 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application created_value = creator( Oct 13 10:58:16.936214 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 13 10:58:16.936214 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 13 10:58:16.936214 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 13 10:58:16.936214 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 13 10:58:16.936214 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 13 10:58:16.936214 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 13 10:58:16.936214 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 13 10:58:16.936214 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application Oct 13 10:58:16.938326 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 245/502] 10.222.0.18 () {56 vars in 1111 bytes} [Thu Oct 13 10:58:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 303 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 10:58:16.945828 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 258/503] 10.222.0.18 () {58 vars in 1024 bytes} [Thu Oct 13 10:58:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 13 10:58:16.946907 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f926d55-d0d7-430f-bed0-e0ebb0bafbc7 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:17.050574 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f926d55-d0d7-430f-bed0-e0ebb0bafbc7 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:17.084906 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fd20cd-a32b-4444-a5a1-867fa3ae2675 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:17.086366 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fd20cd-a32b-4444-a5a1-867fa3ae2675 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:17.086799 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fd20cd-a32b-4444-a5a1-867fa3ae2675 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:17.087261 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fd20cd-a32b-4444-a5a1-867fa3ae2675 None admin] PATH_INFO: `/v3/projects` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:17.088087 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3fd20cd-a32b-4444-a5a1-867fa3ae2675 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 10:58:17.088539 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3fd20cd-a32b-4444-a5a1-867fa3ae2675 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:17.090242 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3fd20cd-a32b-4444-a5a1-867fa3ae2675 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:17.102850 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 246/504] 10.222.0.18 () {56 vars in 1148 bytes} [Thu Oct 13 10:58:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 10:58:17.111366 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b767938-b2ac-4720-90a8-9613a094491f None None] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:17.147991 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fd20cd-a32b-4444-a5a1-867fa3ae2675 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:17.182522 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:58:17.205811 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:58:17.236831 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b767938-b2ac-4720-90a8-9613a094491f None None] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:17.284554 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf42fcfd-b7d5-49aa-b1d4-e810f918c350 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:17.285957 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf42fcfd-b7d5-49aa-b1d4-e810f918c350 None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:17.286683 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf42fcfd-b7d5-49aa-b1d4-e810f918c350 None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:17.287138 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf42fcfd-b7d5-49aa-b1d4-e810f918c350 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:17.288318 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf42fcfd-b7d5-49aa-b1d4-e810f918c350 None admin] RBAC: Adding query filter params (role.id=6af7358ee6934ea2830749333f35aa5c, scope.project.id=112613528384453abe7506465609fbd8, user.id=8fd17114a6034faab30c9003add7199d) {{(pid=81533) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 10:58:17.289335 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf42fcfd-b7d5-49aa-b1d4-e810f918c350 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:17.291176 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf42fcfd-b7d5-49aa-b1d4-e810f918c350 None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:17.308794 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fd20cd-a32b-4444-a5a1-867fa3ae2675 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:17.309499 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 259/505] 10.222.0.18 () {56 vars in 1374 bytes} [Thu Oct 13 10:58:17 2022] GET /identity/v3/role_assignments?user.id=8fd17114a6034faab30c9003add7199d&scope.project.id=112613528384453abe7506465609fbd8&role.id=6af7358ee6934ea2830749333f35aa5c => generated 608 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 10:58:17.310469 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf42fcfd-b7d5-49aa-b1d4-e810f918c350 None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:17.354659 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e173d82-f849-4c65-aa4a-98574d90affa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:17.355978 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e173d82-f849-4c65-aa4a-98574d90affa None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:17.356439 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e173d82-f849-4c65-aa4a-98574d90affa None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:17.356892 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e173d82-f849-4c65-aa4a-98574d90affa None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:17.379222 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e173d82-f849-4c65-aa4a-98574d90affa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 13 10:58:17.387652 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application [None req-1e173d82-f849-4c65-aa4a-98574d90affa None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 13 10:58:17.387652 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 10:58:17.387652 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 10:58:17.387652 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 10:58:17.387652 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 10:58:17.387652 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 10:58:17.387652 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 10:58:17.387652 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 10:58:17.387652 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 10:58:17.387652 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 10:58:17.387652 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 10:58:17.387652 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 10:58:17.387652 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 13 10:58:17.387652 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 13 10:58:17.387652 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 13 10:58:17.387652 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 13 10:58:17.388670 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 13 10:58:17.388670 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 13 10:58:17.388670 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 13 10:58:17.388670 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 13 10:58:17.388670 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 10:58:17.388670 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 10:58:17.388670 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 10:58:17.388670 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 10:58:17.388670 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 10:58:17.388670 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 10:58:17.388670 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 10:58:17.388670 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application with Lock( Oct 13 10:58:17.388670 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 10:58:17.388670 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._enter() Oct 13 10:58:17.388670 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 10:58:17.388670 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 10:58:17.389562 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 10:58:17.389562 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.creator() Oct 13 10:58:17.389562 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 10:58:17.389562 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application created_value = creator( Oct 13 10:58:17.389562 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 13 10:58:17.389562 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 13 10:58:17.389562 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 13 10:58:17.389562 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 13 10:58:17.389562 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 13 10:58:17.389562 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 13 10:58:17.389562 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 13 10:58:17.389562 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application Oct 13 10:58:17.400409 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 247/506] 10.222.0.18 () {56 vars in 1096 bytes} [Thu Oct 13 10:58:17 2022] GET /identity/v3/roles/admin => generated 83 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 13 10:58:17.404696 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e173d82-f849-4c65-aa4a-98574d90affa None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:17.509973 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf42fcfd-b7d5-49aa-b1d4-e810f918c350 None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:17.549975 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:58:17.586105 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43a54e4-7c45-44b4-b817-6b1df3738657 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:17.586786 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43a54e4-7c45-44b4-b817-6b1df3738657 None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:17.587062 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43a54e4-7c45-44b4-b817-6b1df3738657 None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:17.587325 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43a54e4-7c45-44b4-b817-6b1df3738657 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:17.587899 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a43a54e4-7c45-44b4-b817-6b1df3738657 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:17.589286 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a43a54e4-7c45-44b4-b817-6b1df3738657 None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:17.594631 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:58:17.599968 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e173d82-f849-4c65-aa4a-98574d90affa None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:17.606078 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application [None req-a43a54e4-7c45-44b4-b817-6b1df3738657 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 13 10:58:17.606078 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 10:58:17.606078 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 13 10:58:17.606078 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 13 10:58:17.606078 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 13 10:58:17.606078 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 13 10:58:17.606078 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 13 10:58:17.606078 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 13 10:58:17.606078 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 13 10:58:17.606078 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application Oct 13 10:58:17.606078 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 13 10:58:17.606078 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application Oct 13 10:58:17.606078 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 10:58:17.606078 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 10:58:17.606078 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 10:58:17.606078 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 10:58:17.606078 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 10:58:17.607243 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 10:58:17.607243 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 10:58:17.607243 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 10:58:17.607243 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 10:58:17.607243 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 10:58:17.607243 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 10:58:17.607243 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 13 10:58:17.607243 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 13 10:58:17.607243 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 13 10:58:17.607243 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 13 10:58:17.607243 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 10:58:17.607243 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 10:58:17.607243 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 10:58:17.607243 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 10:58:17.607243 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 10:58:17.607243 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 10:58:17.608251 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 10:58:17.608251 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application with Lock( Oct 13 10:58:17.608251 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 10:58:17.608251 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._enter() Oct 13 10:58:17.608251 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 10:58:17.608251 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 10:58:17.608251 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 10:58:17.608251 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.creator() Oct 13 10:58:17.608251 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 10:58:17.608251 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application created_value = creator( Oct 13 10:58:17.608251 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 13 10:58:17.608251 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 13 10:58:17.608251 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 13 10:58:17.608251 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application Oct 13 10:58:17.608251 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 260/507] 10.222.0.18 () {56 vars in 1129 bytes} [Thu Oct 13 10:58:17 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 296 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 10:58:17.611973 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43a54e4-7c45-44b4-b817-6b1df3738657 None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:17.650214 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b02f7a-77c6-499b-bf8c-7840b91b40f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:17.651499 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b02f7a-77c6-499b-bf8c-7840b91b40f7 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:17.651999 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b02f7a-77c6-499b-bf8c-7840b91b40f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:17.652468 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b02f7a-77c6-499b-bf8c-7840b91b40f7 None admin] PATH_INFO: `/v3/roles` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:17.653437 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b02f7a-77c6-499b-bf8c-7840b91b40f7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 10:58:17.653959 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b02f7a-77c6-499b-bf8c-7840b91b40f7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:17.655551 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b02f7a-77c6-499b-bf8c-7840b91b40f7 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:17.665896 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 248/508] 10.222.0.18 () {56 vars in 1099 bytes} [Thu Oct 13 10:58:17 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 13 10:58:17.667458 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78bff1c-e648-4b76-9a1e-fc6862c5d248 None None] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:17.668860 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78bff1c-e648-4b76-9a1e-fc6862c5d248 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:17.669181 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78bff1c-e648-4b76-9a1e-fc6862c5d248 None None] PATH_INFO: `/` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:17.670563 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 249/509] 10.222.0.18 () {54 vars in 927 bytes} [Thu Oct 13 10:58:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 10:58:17.675170 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78bff1c-e648-4b76-9a1e-fc6862c5d248 None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:17.762130 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43a54e4-7c45-44b4-b817-6b1df3738657 None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:17.804735 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629ccb59-7ea1-41f7-a735-e8cb9efecc05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:17.805199 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629ccb59-7ea1-41f7-a735-e8cb9efecc05 None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:17.805480 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629ccb59-7ea1-41f7-a735-e8cb9efecc05 None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:17.805753 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629ccb59-7ea1-41f7-a735-e8cb9efecc05 None admin] PATH_INFO: `/v3/services` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:17.806394 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629ccb59-7ea1-41f7-a735-e8cb9efecc05 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81533) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 10:58:17.806695 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629ccb59-7ea1-41f7-a735-e8cb9efecc05 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:17.808183 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629ccb59-7ea1-41f7-a735-e8cb9efecc05 None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:17.813503 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78bff1c-e648-4b76-9a1e-fc6862c5d248 None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:17.814005 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 261/510] 10.222.0.18 () {56 vars in 1124 bytes} [Thu Oct 13 10:58:17 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 13 10:58:17.822417 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7e7d82-aa56-4ffc-a7c6-81061b839a05 None None] REQUEST_METHOD: `POST` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:17.822698 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7e7d82-aa56-4ffc-a7c6-81061b839a05 None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:17.822973 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7e7d82-aa56-4ffc-a7c6-81061b839a05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:17.849666 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5adf8a6-df41-4e21-920d-f4ea0f5be2d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:17.850295 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5adf8a6-df41-4e21-920d-f4ea0f5be2d1 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:17.850568 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5adf8a6-df41-4e21-920d-f4ea0f5be2d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:17.850835 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5adf8a6-df41-4e21-920d-f4ea0f5be2d1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:17.854611 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:58:17.862265 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.auth.core [None req-1c7e7d82-aa56-4ffc-a7c6-81061b839a05 None None] MFA Rules not processed for user `8ba31ade43694cf8bf28f7528a9ea179`. Rule list: `[]` (Enabled: `True`). {{(pid=81533) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 10:58:17.864603 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-1c7e7d82-aa56-4ffc-a7c6-81061b839a05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 10:58:17.866744 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5adf8a6-df41-4e21-920d-f4ea0f5be2d1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:17.870209 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5adf8a6-df41-4e21-920d-f4ea0f5be2d1 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:17.887589 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application [None req-b5adf8a6-df41-4e21-920d-f4ea0f5be2d1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 13 10:58:17.887589 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 10:58:17.887589 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 10:58:17.887589 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 10:58:17.887589 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 10:58:17.887589 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 10:58:17.887589 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 10:58:17.887589 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 10:58:17.887589 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 10:58:17.887589 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 10:58:17.887589 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 10:58:17.887589 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 10:58:17.887589 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 13 10:58:17.887589 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 13 10:58:17.887589 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 13 10:58:17.887589 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 13 10:58:17.888593 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 10:58:17.888593 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 10:58:17.888593 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 10:58:17.888593 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 10:58:17.888593 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 10:58:17.888593 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 10:58:17.888593 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 10:58:17.888593 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application with Lock( Oct 13 10:58:17.888593 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 10:58:17.888593 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._enter() Oct 13 10:58:17.888593 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 10:58:17.888593 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 10:58:17.888593 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 10:58:17.888593 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.creator() Oct 13 10:58:17.888593 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 10:58:17.888593 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application created_value = creator( Oct 13 10:58:17.888593 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 13 10:58:17.889522 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 13 10:58:17.889522 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 13 10:58:17.889522 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application Oct 13 10:58:17.889522 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 250/511] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Oct 13 10:58:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 10:58:17.889522 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5adf8a6-df41-4e21-920d-f4ea0f5be2d1 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:17.946556 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:58:17.958585 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 262/512] 10.222.0.18 () {58 vars in 1024 bytes} [Thu Oct 13 10:58:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 13 10:58:17.961126 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bed0ac0-251f-4dd4-8347-c06703cc4d16 None None] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:17.961604 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bed0ac0-251f-4dd4-8347-c06703cc4d16 None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:17.962326 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bed0ac0-251f-4dd4-8347-c06703cc4d16 None None] PATH_INFO: `/` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:17.964866 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 263/513] 10.222.0.18 () {54 vars in 927 bytes} [Thu Oct 13 10:58:17 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 10:58:17.965921 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bed0ac0-251f-4dd4-8347-c06703cc4d16 None None] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:18.051153 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5adf8a6-df41-4e21-920d-f4ea0f5be2d1 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:18.119446 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eaaf720-1961-4174-807f-5c3bb505ef2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:18.120063 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eaaf720-1961-4174-807f-5c3bb505ef2d None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:18.120340 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eaaf720-1961-4174-807f-5c3bb505ef2d None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:18.120610 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eaaf720-1961-4174-807f-5c3bb505ef2d None admin] PATH_INFO: `/v3/services` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:18.121414 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eaaf720-1961-4174-807f-5c3bb505ef2d None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 10:58:18.121589 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eaaf720-1961-4174-807f-5c3bb505ef2d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:18.122937 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eaaf720-1961-4174-807f-5c3bb505ef2d None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:18.129388 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 251/514] 10.222.0.18 () {56 vars in 1124 bytes} [Thu Oct 13 10:58:17 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 10:58:18.131107 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80329441-f9ff-41dd-81aa-dcc0273b0b56 None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:18.131645 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80329441-f9ff-41dd-81aa-dcc0273b0b56 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:18.131921 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80329441-f9ff-41dd-81aa-dcc0273b0b56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:18.154503 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bed0ac0-251f-4dd4-8347-c06703cc4d16 None None] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:18.158612 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-80329441-f9ff-41dd-81aa-dcc0273b0b56 None None] MFA Rules not processed for user `8ba31ade43694cf8bf28f7528a9ea179`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 10:58:18.160450 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-80329441-f9ff-41dd-81aa-dcc0273b0b56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 10:58:18.228278 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd23c5b8-674b-48ef-87a1-37a058d3f11e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:18.229322 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd23c5b8-674b-48ef-87a1-37a058d3f11e None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:18.229832 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd23c5b8-674b-48ef-87a1-37a058d3f11e None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:18.230336 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd23c5b8-674b-48ef-87a1-37a058d3f11e None admin] PATH_INFO: `/v3/domains` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:18.231226 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd23c5b8-674b-48ef-87a1-37a058d3f11e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81533) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 10:58:18.231742 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd23c5b8-674b-48ef-87a1-37a058d3f11e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:18.233664 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd23c5b8-674b-48ef-87a1-37a058d3f11e None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:18.264442 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 264/515] 10.222.0.18 () {56 vars in 1109 bytes} [Thu Oct 13 10:58:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 10:58:18.265805 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd23c5b8-674b-48ef-87a1-37a058d3f11e None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:18.267424 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:58:18.292839 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 252/516] 10.222.0.18 () {58 vars in 1024 bytes} [Thu Oct 13 10:58:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 13 10:58:18.298277 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80329441-f9ff-41dd-81aa-dcc0273b0b56 None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:18.335813 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:58:18.402867 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd23c5b8-674b-48ef-87a1-37a058d3f11e None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:18.427447 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80329441-f9ff-41dd-81aa-dcc0273b0b56 None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:18.442646 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7249e141-67f2-4b34-900c-6c619a26915e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:18.443719 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7249e141-67f2-4b34-900c-6c619a26915e None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:18.444428 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7249e141-67f2-4b34-900c-6c619a26915e None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:18.444801 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7249e141-67f2-4b34-900c-6c619a26915e None admin] PATH_INFO: `/v3/users/nova` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:18.453703 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7249e141-67f2-4b34-900c-6c619a26915e None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:18.455488 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7249e141-67f2-4b34-900c-6c619a26915e None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:18.468252 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application [None req-7249e141-67f2-4b34-900c-6c619a26915e None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 13 10:58:18.468252 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 10:58:18.468252 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 10:58:18.468252 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 10:58:18.468252 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 10:58:18.468252 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 10:58:18.468252 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 10:58:18.468252 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 10:58:18.468252 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 10:58:18.468252 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 10:58:18.468252 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 10:58:18.468252 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 10:58:18.468252 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 13 10:58:18.468252 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 13 10:58:18.468252 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 13 10:58:18.468252 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 13 10:58:18.469279 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 10:58:18.469279 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 10:58:18.469279 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 13 10:58:18.469279 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 13 10:58:18.469279 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 13 10:58:18.469279 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 13 10:58:18.469279 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 10:58:18.469279 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 10:58:18.469279 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 10:58:18.469279 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 10:58:18.469279 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 10:58:18.469279 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application with Lock( Oct 13 10:58:18.469279 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 10:58:18.469279 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._enter() Oct 13 10:58:18.469279 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 10:58:18.469279 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 10:58:18.469279 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 10:58:18.469279 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.creator() Oct 13 10:58:18.470628 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 10:58:18.470628 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application created_value = creator( Oct 13 10:58:18.470628 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 13 10:58:18.470628 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 13 10:58:18.470628 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 13 10:58:18.470628 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 13 10:58:18.470628 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 13 10:58:18.470628 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 13 10:58:18.470628 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 13 10:58:18.470628 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application Oct 13 10:58:18.470628 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 265/517] 10.222.0.18 () {56 vars in 1093 bytes} [Thu Oct 13 10:58:18 2022] GET /identity/v3/users/nova => generated 82 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 10:58:18.472210 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d2fa5b-3c00-4476-92aa-6d4aac96b0fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:18.472845 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d2fa5b-3c00-4476-92aa-6d4aac96b0fd None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:18.473165 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d2fa5b-3c00-4476-92aa-6d4aac96b0fd None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:18.473438 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d2fa5b-3c00-4476-92aa-6d4aac96b0fd None admin] PATH_INFO: `/v3/services/network` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:18.474119 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d2fa5b-3c00-4476-92aa-6d4aac96b0fd None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:18.475013 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7249e141-67f2-4b34-900c-6c619a26915e None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:18.475509 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d2fa5b-3c00-4476-92aa-6d4aac96b0fd None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:18.489997 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application [None req-c4d2fa5b-3c00-4476-92aa-6d4aac96b0fd None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Oct 13 10:58:18.489997 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 10:58:18.489997 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 13 10:58:18.489997 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 13 10:58:18.489997 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 13 10:58:18.489997 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 13 10:58:18.489997 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 13 10:58:18.489997 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 13 10:58:18.489997 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 13 10:58:18.489997 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application Oct 13 10:58:18.489997 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 13 10:58:18.489997 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application Oct 13 10:58:18.489997 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 10:58:18.489997 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 10:58:18.489997 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 10:58:18.489997 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 10:58:18.489997 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 10:58:18.491018 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 10:58:18.491018 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 10:58:18.491018 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 10:58:18.491018 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 10:58:18.491018 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 10:58:18.491018 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 10:58:18.491018 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 13 10:58:18.491018 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 13 10:58:18.491018 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 13 10:58:18.491018 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 13 10:58:18.491018 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 10:58:18.491018 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 10:58:18.491018 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 10:58:18.491018 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 10:58:18.491018 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 10:58:18.491018 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 10:58:18.491962 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 10:58:18.491962 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application with Lock( Oct 13 10:58:18.491962 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 10:58:18.491962 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._enter() Oct 13 10:58:18.491962 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 10:58:18.491962 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 10:58:18.491962 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 10:58:18.491962 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.creator() Oct 13 10:58:18.491962 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 10:58:18.491962 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application created_value = creator( Oct 13 10:58:18.491962 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 13 10:58:18.491962 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 13 10:58:18.491962 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 13 10:58:18.491962 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application Oct 13 10:58:18.496159 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 253/518] 10.222.0.18 () {56 vars in 1111 bytes} [Thu Oct 13 10:58:18 2022] GET /identity/v3/services/network => generated 88 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 10:58:18.497492 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d2fa5b-3c00-4476-92aa-6d4aac96b0fd None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:18.558136 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:58:18.629316 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7249e141-67f2-4b34-900c-6c619a26915e None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:18.631024 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d2fa5b-3c00-4476-92aa-6d4aac96b0fd None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:18.645384 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:58:18.668884 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877f5169-96f9-4848-9974-6d24fe7e2a72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:18.669524 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877f5169-96f9-4848-9974-6d24fe7e2a72 None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:18.669803 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877f5169-96f9-4848-9974-6d24fe7e2a72 None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:18.670078 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877f5169-96f9-4848-9974-6d24fe7e2a72 None admin] PATH_INFO: `/v3/users` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:18.670804 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-877f5169-96f9-4848-9974-6d24fe7e2a72 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81533) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 10:58:18.671109 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-877f5169-96f9-4848-9974-6d24fe7e2a72 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:18.672535 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-877f5169-96f9-4848-9974-6d24fe7e2a72 None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:18.681875 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27cec601-4a15-48a3-980d-b7eb82bedc15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:18.683411 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cec601-4a15-48a3-980d-b7eb82bedc15 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:18.683710 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cec601-4a15-48a3-980d-b7eb82bedc15 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:18.683987 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cec601-4a15-48a3-980d-b7eb82bedc15 None admin] PATH_INFO: `/v3/services` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:18.684621 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27cec601-4a15-48a3-980d-b7eb82bedc15 None admin] RBAC: Adding query filter params (name=network) {{(pid=81534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 10:58:18.684924 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27cec601-4a15-48a3-980d-b7eb82bedc15 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:18.686811 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27cec601-4a15-48a3-980d-b7eb82bedc15 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:18.695977 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 266/520] 10.222.0.18 () {56 vars in 1133 bytes} [Thu Oct 13 10:58:18 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 10:58:18.696138 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 254/520] 10.222.0.18 () {56 vars in 1112 bytes} [Thu Oct 13 10:58:18 2022] GET /identity/v3/services?name=network => generated 124 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 10:58:18.696944 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877f5169-96f9-4848-9974-6d24fe7e2a72 None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:18.697904 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27cec601-4a15-48a3-980d-b7eb82bedc15 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:18.815526 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27cec601-4a15-48a3-980d-b7eb82bedc15 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:18.826422 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:58:18.836403 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877f5169-96f9-4848-9974-6d24fe7e2a72 None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:18.852340 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e16f8a-066f-4e8f-856b-f58023b5906a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:18.853374 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e16f8a-066f-4e8f-856b-f58023b5906a None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:18.853513 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e16f8a-066f-4e8f-856b-f58023b5906a None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:18.853856 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e16f8a-066f-4e8f-856b-f58023b5906a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:18.866306 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e16f8a-066f-4e8f-856b-f58023b5906a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:18.868718 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e16f8a-066f-4e8f-856b-f58023b5906a None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:18.877467 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf549ae-0fb0-4130-b1b2-bbefdd579910 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:18.878309 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf549ae-0fb0-4130-b1b2-bbefdd579910 None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:18.878736 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf549ae-0fb0-4130-b1b2-bbefdd579910 None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:18.879158 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf549ae-0fb0-4130-b1b2-bbefdd579910 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:18.884637 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application [None req-29e16f8a-066f-4e8f-856b-f58023b5906a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 13 10:58:18.884637 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 10:58:18.884637 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 10:58:18.884637 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 10:58:18.884637 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 10:58:18.884637 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 10:58:18.884637 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 10:58:18.884637 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 10:58:18.884637 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 10:58:18.884637 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 10:58:18.884637 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 10:58:18.884637 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 10:58:18.884637 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 13 10:58:18.884637 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 13 10:58:18.884637 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 13 10:58:18.884637 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 13 10:58:18.885817 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 10:58:18.885817 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 10:58:18.885817 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 10:58:18.885817 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 10:58:18.885817 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 10:58:18.885817 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 10:58:18.885817 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 10:58:18.885817 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application with Lock( Oct 13 10:58:18.885817 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 10:58:18.885817 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._enter() Oct 13 10:58:18.885817 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 10:58:18.885817 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 10:58:18.885817 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 10:58:18.885817 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.creator() Oct 13 10:58:18.885817 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 10:58:18.885817 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application created_value = creator( Oct 13 10:58:18.885817 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 13 10:58:18.886944 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 13 10:58:18.886944 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 13 10:58:18.886944 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application Oct 13 10:58:18.892734 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 255/521] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Oct 13 10:58:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 10:58:18.893296 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf549ae-0fb0-4130-b1b2-bbefdd579910 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:18.893797 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e16f8a-066f-4e8f-856b-f58023b5906a None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:18.895111 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf549ae-0fb0-4130-b1b2-bbefdd579910 None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:18.911953 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application [None req-6cf549ae-0fb0-4130-b1b2-bbefdd579910 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 13 10:58:18.911953 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 10:58:18.911953 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 10:58:18.911953 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 10:58:18.911953 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 10:58:18.911953 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 10:58:18.911953 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 10:58:18.911953 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 10:58:18.911953 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 10:58:18.911953 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 10:58:18.911953 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 10:58:18.911953 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 10:58:18.911953 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 13 10:58:18.911953 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 13 10:58:18.911953 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 13 10:58:18.911953 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 13 10:58:18.913145 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 10:58:18.913145 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 10:58:18.913145 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 10:58:18.913145 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 10:58:18.913145 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 10:58:18.913145 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 10:58:18.913145 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 10:58:18.913145 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application with Lock( Oct 13 10:58:18.913145 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 10:58:18.913145 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._enter() Oct 13 10:58:18.913145 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 10:58:18.913145 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 10:58:18.913145 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 10:58:18.913145 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.creator() Oct 13 10:58:18.913145 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 10:58:18.913145 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application created_value = creator( Oct 13 10:58:18.913145 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 13 10:58:18.914334 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 13 10:58:18.914334 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 13 10:58:18.914334 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application Oct 13 10:58:18.916096 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 267/522] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Oct 13 10:58:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 10:58:18.917069 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf549ae-0fb0-4130-b1b2-bbefdd579910 None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:18.944739 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:58:19.008703 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e16f8a-066f-4e8f-856b-f58023b5906a None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:19.029751 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf549ae-0fb0-4130-b1b2-bbefdd579910 None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:19.053452 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574cbc9f-e08c-4d0f-9e90-4722d8bd7b0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:19.054133 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574cbc9f-e08c-4d0f-9e90-4722d8bd7b0f None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:19.054545 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574cbc9f-e08c-4d0f-9e90-4722d8bd7b0f None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:19.055075 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574cbc9f-e08c-4d0f-9e90-4722d8bd7b0f None admin] PATH_INFO: `/v3/services` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:19.055723 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574cbc9f-e08c-4d0f-9e90-4722d8bd7b0f None admin] RBAC: Adding query filter params (type=network) {{(pid=81534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 10:58:19.056465 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574cbc9f-e08c-4d0f-9e90-4722d8bd7b0f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:19.058240 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574cbc9f-e08c-4d0f-9e90-4722d8bd7b0f None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:19.069118 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 256/523] 10.222.0.18 () {56 vars in 1112 bytes} [Thu Oct 13 10:58:18 2022] GET /identity/v3/services?type=network => generated 124 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 10:58:19.069118 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574cbc9f-e08c-4d0f-9e90-4722d8bd7b0f None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:19.078378 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c77488e-574c-41fc-baa8-92d868e958d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:19.079310 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c77488e-574c-41fc-baa8-92d868e958d3 None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:19.079766 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c77488e-574c-41fc-baa8-92d868e958d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:19.080310 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c77488e-574c-41fc-baa8-92d868e958d3 None admin] PATH_INFO: `/v3/domains` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:19.080972 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c77488e-574c-41fc-baa8-92d868e958d3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81533) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 10:58:19.081309 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c77488e-574c-41fc-baa8-92d868e958d3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:19.082698 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c77488e-574c-41fc-baa8-92d868e958d3 None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:19.104417 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:58:19.111130 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 268/524] 10.222.0.18 () {56 vars in 1109 bytes} [Thu Oct 13 10:58:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 10:58:19.118086 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c77488e-574c-41fc-baa8-92d868e958d3 None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:19.215657 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574cbc9f-e08c-4d0f-9e90-4722d8bd7b0f None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:19.263349 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0e6626-4e71-492a-b139-17a702ebc366 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:19.264148 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0e6626-4e71-492a-b139-17a702ebc366 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:19.264528 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0e6626-4e71-492a-b139-17a702ebc366 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:19.264898 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0e6626-4e71-492a-b139-17a702ebc366 None admin] PATH_INFO: `/v3/domains` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:19.265675 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0e6626-4e71-492a-b139-17a702ebc366 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 10:58:19.266077 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0e6626-4e71-492a-b139-17a702ebc366 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:19.267644 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0e6626-4e71-492a-b139-17a702ebc366 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:19.270173 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:58:19.289992 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c77488e-574c-41fc-baa8-92d868e958d3 None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:19.293690 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 257/525] 10.222.0.18 () {56 vars in 1109 bytes} [Thu Oct 13 10:58:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 10:58:19.299137 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0e6626-4e71-492a-b139-17a702ebc366 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:19.328170 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1b8c90-6d59-42a1-9f8b-799a5846a223 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:19.329097 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1b8c90-6d59-42a1-9f8b-799a5846a223 None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:19.329520 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1b8c90-6d59-42a1-9f8b-799a5846a223 None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:19.329924 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1b8c90-6d59-42a1-9f8b-799a5846a223 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:19.337899 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1b8c90-6d59-42a1-9f8b-799a5846a223 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:19.339549 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1b8c90-6d59-42a1-9f8b-799a5846a223 None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:19.351978 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application [None req-1a1b8c90-6d59-42a1-9f8b-799a5846a223 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 13 10:58:19.351978 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 10:58:19.351978 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 10:58:19.351978 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 10:58:19.351978 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 10:58:19.351978 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 10:58:19.351978 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 10:58:19.351978 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 10:58:19.351978 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 10:58:19.351978 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 10:58:19.351978 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 10:58:19.351978 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 10:58:19.351978 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 13 10:58:19.351978 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 13 10:58:19.351978 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 13 10:58:19.353146 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 13 10:58:19.353146 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 10:58:19.353146 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 10:58:19.353146 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 10:58:19.353146 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 10:58:19.353146 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 10:58:19.353146 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 10:58:19.353146 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 10:58:19.353146 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application with Lock( Oct 13 10:58:19.353146 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 10:58:19.353146 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._enter() Oct 13 10:58:19.353146 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 10:58:19.353146 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 10:58:19.353146 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 10:58:19.353146 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.creator() Oct 13 10:58:19.353146 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 10:58:19.353146 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application created_value = creator( Oct 13 10:58:19.354275 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 13 10:58:19.354275 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 13 10:58:19.354275 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 13 10:58:19.354275 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 13 10:58:19.354275 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 13 10:58:19.354275 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 13 10:58:19.354275 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 13 10:58:19.354275 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application Oct 13 10:58:19.355971 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 269/526] 10.222.0.18 () {56 vars in 1111 bytes} [Thu Oct 13 10:58:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 10:58:19.362640 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1b8c90-6d59-42a1-9f8b-799a5846a223 None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:19.422724 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:58:19.440436 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0e6626-4e71-492a-b139-17a702ebc366 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:19.478854 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1b8c90-6d59-42a1-9f8b-799a5846a223 None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:19.479048 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84bf2e1f-e084-404c-a2d2-7905d6490313 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:19.479595 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bf2e1f-e084-404c-a2d2-7905d6490313 None admin] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:19.479877 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bf2e1f-e084-404c-a2d2-7905d6490313 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:19.480147 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bf2e1f-e084-404c-a2d2-7905d6490313 None admin] PATH_INFO: `/v3/users` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:19.480798 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84bf2e1f-e084-404c-a2d2-7905d6490313 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:19.482337 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84bf2e1f-e084-404c-a2d2-7905d6490313 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:19.512553 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 258/527] 10.222.0.18 () {60 vars in 1132 bytes} [Thu Oct 13 10:58:19 2022] POST /identity/v3/users => generated 254 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 13 10:58:19.519667 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c29e44-73ba-41c7-90f5-152da22323e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:19.520705 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c29e44-73ba-41c7-90f5-152da22323e5 None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:19.521240 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c29e44-73ba-41c7-90f5-152da22323e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:19.521723 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c29e44-73ba-41c7-90f5-152da22323e5 None admin] PATH_INFO: `/v3/projects` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:19.522675 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c29e44-73ba-41c7-90f5-152da22323e5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81533) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 10:58:19.523348 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c29e44-73ba-41c7-90f5-152da22323e5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:19.525130 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c29e44-73ba-41c7-90f5-152da22323e5 None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:19.540188 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 270/528] 10.222.0.18 () {56 vars in 1148 bytes} [Thu Oct 13 10:58:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 13 10:58:19.545768 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84bf2e1f-e084-404c-a2d2-7905d6490313 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:19.668507 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84bf2e1f-e084-404c-a2d2-7905d6490313 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:19.715604 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67fe831-c785-4aa5-8ac4-14d35cc5bbde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:19.716692 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67fe831-c785-4aa5-8ac4-14d35cc5bbde None admin] REQUEST_METHOD: `PUT` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:19.717212 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67fe831-c785-4aa5-8ac4-14d35cc5bbde None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:19.717691 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67fe831-c785-4aa5-8ac4-14d35cc5bbde None admin] PATH_INFO: `/v3/projects/112613528384453abe7506465609fbd8/users/bc5b13f97c0e4a31940b5b73a916af29/roles/30a6d59262144d4d956f4d4207864030` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:19.722401 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67fe831-c785-4aa5-8ac4-14d35cc5bbde None admin] RBAC: Authorizing `identity:create_grant(project_id=112613528384453abe7506465609fbd8, user_id=bc5b13f97c0e4a31940b5b73a916af29, role_id=30a6d59262144d4d956f4d4207864030)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:19.724104 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67fe831-c785-4aa5-8ac4-14d35cc5bbde None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:19.753174 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 259/529] 10.222.0.18 () {58 vars in 1439 bytes} [Thu Oct 13 10:58:19 2022] PUT /identity/v3/projects/112613528384453abe7506465609fbd8/users/bc5b13f97c0e4a31940b5b73a916af29/roles/30a6d59262144d4d956f4d4207864030 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 13 10:58:19.963581 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e5652e-af0a-4a25-91f4-50e03483cfa1 None None] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:19.964086 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e5652e-af0a-4a25-91f4-50e03483cfa1 None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:19.964086 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e5652e-af0a-4a25-91f4-50e03483cfa1 None None] PATH_INFO: `/` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:19.965412 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 271/530] 10.222.0.18 () {54 vars in 927 bytes} [Thu Oct 13 10:58:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 13 10:58:19.971071 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa99422-db13-4ecc-bdee-d232c3b22c5f None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:19.971364 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa99422-db13-4ecc-bdee-d232c3b22c5f None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:19.971647 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa99422-db13-4ecc-bdee-d232c3b22c5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:19.982532 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:58:19.998082 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-2fa99422-db13-4ecc-bdee-d232c3b22c5f None None] MFA Rules not processed for user `8ba31ade43694cf8bf28f7528a9ea179`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 10:58:19.999977 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-2fa99422-db13-4ecc-bdee-d232c3b22c5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 10:58:20.069833 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 260/531] 10.222.0.18 () {58 vars in 1024 bytes} [Thu Oct 13 10:58:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 13 10:58:20.453507 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e5652e-af0a-4a25-91f4-50e03483cfa1 None None] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:20.457516 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:58:20.586865 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e5652e-af0a-4a25-91f4-50e03483cfa1 None None] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:20.633590 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ebcbad-1ebf-4f44-9ec7-f31430cecc3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:20.634257 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ebcbad-1ebf-4f44-9ec7-f31430cecc3f None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:20.634533 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ebcbad-1ebf-4f44-9ec7-f31430cecc3f None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:20.634802 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ebcbad-1ebf-4f44-9ec7-f31430cecc3f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:20.647047 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ebcbad-1ebf-4f44-9ec7-f31430cecc3f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 13 10:58:20.652233 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application [None req-21ebcbad-1ebf-4f44-9ec7-f31430cecc3f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 13 10:58:20.652233 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 10:58:20.652233 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 10:58:20.652233 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 10:58:20.652233 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 10:58:20.652233 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 10:58:20.652233 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 10:58:20.652233 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 10:58:20.652233 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 10:58:20.652233 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 10:58:20.652233 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 10:58:20.652233 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 10:58:20.652233 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 13 10:58:20.652233 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 13 10:58:20.652233 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 13 10:58:20.652233 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 13 10:58:20.653206 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 13 10:58:20.653206 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 13 10:58:20.653206 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 13 10:58:20.653206 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 13 10:58:20.653206 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 10:58:20.653206 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 10:58:20.653206 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 10:58:20.653206 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 10:58:20.653206 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 10:58:20.653206 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 10:58:20.653206 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 10:58:20.653206 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application with Lock( Oct 13 10:58:20.653206 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 10:58:20.653206 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._enter() Oct 13 10:58:20.653206 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 10:58:20.653206 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 10:58:20.654086 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 10:58:20.654086 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.creator() Oct 13 10:58:20.654086 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 10:58:20.654086 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application created_value = creator( Oct 13 10:58:20.654086 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 13 10:58:20.654086 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 13 10:58:20.654086 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 13 10:58:20.654086 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 13 10:58:20.654086 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 13 10:58:20.654086 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 13 10:58:20.654086 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 13 10:58:20.654086 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application Oct 13 10:58:20.657826 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 272/532] 10.222.0.18 () {56 vars in 1096 bytes} [Thu Oct 13 10:58:20 2022] GET /identity/v3/roles/admin => generated 83 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 10:58:20.663458 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa99422-db13-4ecc-bdee-d232c3b22c5f None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:20.818895 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa99422-db13-4ecc-bdee-d232c3b22c5f None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:20.858880 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:58:20.868223 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93597e8c-c9be-4b14-90d6-5f30a089d404 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:20.868843 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93597e8c-c9be-4b14-90d6-5f30a089d404 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:20.869177 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93597e8c-c9be-4b14-90d6-5f30a089d404 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:20.869449 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93597e8c-c9be-4b14-90d6-5f30a089d404 None admin] PATH_INFO: `/v3/roles` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:20.870126 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93597e8c-c9be-4b14-90d6-5f30a089d404 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 10:58:20.870430 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93597e8c-c9be-4b14-90d6-5f30a089d404 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:20.871795 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93597e8c-c9be-4b14-90d6-5f30a089d404 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:20.886257 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 261/533] 10.222.0.18 () {56 vars in 1099 bytes} [Thu Oct 13 10:58:20 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 10:58:20.892208 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ebcbad-1ebf-4f44-9ec7-f31430cecc3f None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:20.980155 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:58:21.022140 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ebcbad-1ebf-4f44-9ec7-f31430cecc3f None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:21.063698 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af037fd-5b8a-4d23-bc85-2460520526ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:21.064330 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af037fd-5b8a-4d23-bc85-2460520526ef None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:21.064608 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af037fd-5b8a-4d23-bc85-2460520526ef None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:21.064877 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af037fd-5b8a-4d23-bc85-2460520526ef None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:21.075576 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af037fd-5b8a-4d23-bc85-2460520526ef None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:21.077055 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af037fd-5b8a-4d23-bc85-2460520526ef None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:21.080202 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a628ac-281e-4e07-a642-1cbcd7de2556 None None] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:21.080495 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a628ac-281e-4e07-a642-1cbcd7de2556 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:21.080773 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a628ac-281e-4e07-a642-1cbcd7de2556 None None] PATH_INFO: `/` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:21.082411 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 262/534] 10.222.0.18 () {54 vars in 927 bytes} [Thu Oct 13 10:58:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 10:58:21.087950 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaad3348-cb6d-41ae-a6d7-bb5e08dd5fbd None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:21.088233 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaad3348-cb6d-41ae-a6d7-bb5e08dd5fbd None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:21.088508 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaad3348-cb6d-41ae-a6d7-bb5e08dd5fbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:21.093464 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application [None req-8af037fd-5b8a-4d23-bc85-2460520526ef None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 13 10:58:21.093464 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 10:58:21.093464 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 10:58:21.093464 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 10:58:21.093464 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 10:58:21.093464 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 10:58:21.093464 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 10:58:21.093464 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 10:58:21.093464 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 10:58:21.093464 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 10:58:21.093464 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 10:58:21.093464 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 10:58:21.093464 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 13 10:58:21.093464 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 13 10:58:21.093464 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 13 10:58:21.093464 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 13 10:58:21.094389 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 10:58:21.094389 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 10:58:21.094389 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 10:58:21.094389 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 10:58:21.094389 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 10:58:21.094389 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 10:58:21.094389 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 10:58:21.094389 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application with Lock( Oct 13 10:58:21.094389 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 10:58:21.094389 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._enter() Oct 13 10:58:21.094389 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 10:58:21.094389 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 10:58:21.094389 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 10:58:21.094389 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.creator() Oct 13 10:58:21.094389 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 10:58:21.094389 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application created_value = creator( Oct 13 10:58:21.094389 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 13 10:58:21.096512 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 13 10:58:21.096512 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 13 10:58:21.096512 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application Oct 13 10:58:21.096512 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 273/535] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Oct 13 10:58:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 10:58:21.100245 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af037fd-5b8a-4d23-bc85-2460520526ef None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:21.130093 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-aaad3348-cb6d-41ae-a6d7-bb5e08dd5fbd None None] MFA Rules not processed for user `8ba31ade43694cf8bf28f7528a9ea179`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 10:58:21.131635 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-aaad3348-cb6d-41ae-a6d7-bb5e08dd5fbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 10:58:21.203578 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af037fd-5b8a-4d23-bc85-2460520526ef None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:21.220040 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:58:21.241230 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16d6376-8fad-4206-a0fc-000caf27a95c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:21.242355 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16d6376-8fad-4206-a0fc-000caf27a95c None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:21.242637 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16d6376-8fad-4206-a0fc-000caf27a95c None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:21.242913 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16d6376-8fad-4206-a0fc-000caf27a95c None admin] PATH_INFO: `/v3/domains` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:21.243555 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16d6376-8fad-4206-a0fc-000caf27a95c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81533) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 10:58:21.243857 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16d6376-8fad-4206-a0fc-000caf27a95c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:21.245243 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16d6376-8fad-4206-a0fc-000caf27a95c None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:21.260005 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 274/536] 10.222.0.18 () {56 vars in 1109 bytes} [Thu Oct 13 10:58:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 10:58:21.266768 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16d6376-8fad-4206-a0fc-000caf27a95c None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:21.269544 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 263/537] 10.222.0.18 () {58 vars in 1024 bytes} [Thu Oct 13 10:58:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 13 10:58:21.370174 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16d6376-8fad-4206-a0fc-000caf27a95c None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:21.405194 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d2edef-4da4-4242-a068-c2cd9627384f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:21.405826 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d2edef-4da4-4242-a068-c2cd9627384f None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:21.406102 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d2edef-4da4-4242-a068-c2cd9627384f None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:21.406371 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d2edef-4da4-4242-a068-c2cd9627384f None admin] PATH_INFO: `/v3/users/swift` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:21.414253 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d2edef-4da4-4242-a068-c2cd9627384f None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:21.415778 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d2edef-4da4-4242-a068-c2cd9627384f None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:21.428764 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application [None req-c9d2edef-4da4-4242-a068-c2cd9627384f None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Oct 13 10:58:21.428764 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 10:58:21.428764 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 10:58:21.428764 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 10:58:21.428764 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 10:58:21.428764 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 10:58:21.428764 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 10:58:21.428764 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 10:58:21.428764 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 10:58:21.428764 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 10:58:21.428764 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 10:58:21.428764 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 10:58:21.428764 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 13 10:58:21.428764 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 13 10:58:21.428764 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 13 10:58:21.428764 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 13 10:58:21.430105 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 10:58:21.430105 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 10:58:21.430105 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 13 10:58:21.430105 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 13 10:58:21.430105 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 13 10:58:21.430105 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 13 10:58:21.430105 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 10:58:21.430105 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 10:58:21.430105 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 10:58:21.430105 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 10:58:21.430105 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 10:58:21.430105 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application with Lock( Oct 13 10:58:21.430105 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 10:58:21.430105 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._enter() Oct 13 10:58:21.430105 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 10:58:21.430105 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 10:58:21.430105 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 10:58:21.430105 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.creator() Oct 13 10:58:21.431176 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 10:58:21.431176 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application created_value = creator( Oct 13 10:58:21.431176 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 13 10:58:21.431176 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 13 10:58:21.431176 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 13 10:58:21.431176 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 13 10:58:21.431176 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 13 10:58:21.431176 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 13 10:58:21.431176 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Oct 13 10:58:21.431176 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application Oct 13 10:58:21.431176 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 275/538] 10.222.0.18 () {56 vars in 1096 bytes} [Thu Oct 13 10:58:21 2022] GET /identity/v3/users/swift => generated 83 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 10:58:21.438245 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaad3348-cb6d-41ae-a6d7-bb5e08dd5fbd None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:21.585054 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaad3348-cb6d-41ae-a6d7-bb5e08dd5fbd None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:21.594801 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d2edef-4da4-4242-a068-c2cd9627384f None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:21.615975 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:58:21.636079 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0301ea8-b067-4175-8abd-48f776249ed0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:21.636608 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0301ea8-b067-4175-8abd-48f776249ed0 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:21.636882 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0301ea8-b067-4175-8abd-48f776249ed0 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:21.637188 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0301ea8-b067-4175-8abd-48f776249ed0 None admin] PATH_INFO: `/v3/users` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:21.637917 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0301ea8-b067-4175-8abd-48f776249ed0 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 10:58:21.638216 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0301ea8-b067-4175-8abd-48f776249ed0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:21.639633 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0301ea8-b067-4175-8abd-48f776249ed0 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:21.641356 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:58:21.666478 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 264/539] 10.222.0.18 () {56 vars in 1135 bytes} [Thu Oct 13 10:58:21 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 10:58:21.671860 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0301ea8-b067-4175-8abd-48f776249ed0 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:21.715500 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d2edef-4da4-4242-a068-c2cd9627384f None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:21.765848 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c6480d-b0c9-420a-a498-56a0c3d94eea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:21.766455 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c6480d-b0c9-420a-a498-56a0c3d94eea None admin] REQUEST_METHOD: `POST` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:21.766728 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c6480d-b0c9-420a-a498-56a0c3d94eea None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:21.766995 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c6480d-b0c9-420a-a498-56a0c3d94eea None admin] PATH_INFO: `/v3/services` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:21.767647 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c6480d-b0c9-420a-a498-56a0c3d94eea None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:21.769028 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c6480d-b0c9-420a-a498-56a0c3d94eea None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:21.800810 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 276/540] 10.222.0.18 () {60 vars in 1141 bytes} [Thu Oct 13 10:58:21 2022] POST /identity/v3/services => generated 251 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 13 10:58:21.831657 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0301ea8-b067-4175-8abd-48f776249ed0 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:21.885360 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d0b763-959e-47ff-9c1e-ca8c0982cb05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:21.886076 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d0b763-959e-47ff-9c1e-ca8c0982cb05 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:21.886417 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d0b763-959e-47ff-9c1e-ca8c0982cb05 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:21.886682 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d0b763-959e-47ff-9c1e-ca8c0982cb05 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:21.911641 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d0b763-959e-47ff-9c1e-ca8c0982cb05 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:21.913186 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d0b763-959e-47ff-9c1e-ca8c0982cb05 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:21.934344 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application [None req-13d0b763-959e-47ff-9c1e-ca8c0982cb05 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 13 10:58:21.934344 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 10:58:21.934344 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 10:58:21.934344 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 10:58:21.934344 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 10:58:21.934344 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 10:58:21.934344 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 10:58:21.934344 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 10:58:21.934344 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 10:58:21.934344 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 10:58:21.934344 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 10:58:21.934344 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 10:58:21.934344 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 13 10:58:21.934344 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 13 10:58:21.934344 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 13 10:58:21.934344 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 13 10:58:21.936749 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 10:58:21.936749 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 10:58:21.936749 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 10:58:21.936749 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 10:58:21.936749 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 10:58:21.936749 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 10:58:21.936749 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 10:58:21.936749 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application with Lock( Oct 13 10:58:21.936749 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 10:58:21.936749 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._enter() Oct 13 10:58:21.936749 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 10:58:21.936749 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 10:58:21.936749 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 10:58:21.936749 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.creator() Oct 13 10:58:21.936749 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 10:58:21.936749 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application created_value = creator( Oct 13 10:58:21.936749 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 13 10:58:21.939155 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 13 10:58:21.939155 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 13 10:58:21.939155 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application Oct 13 10:58:21.939155 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 265/541] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Oct 13 10:58:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 264 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 10:58:21.941398 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c6480d-b0c9-420a-a498-56a0c3d94eea None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:22.026545 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b117b9-d5c4-4b8d-9025-45b8338d9caf None None] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:22.026875 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b117b9-d5c4-4b8d-9025-45b8338d9caf None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:22.027078 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b117b9-d5c4-4b8d-9025-45b8338d9caf None None] PATH_INFO: `/` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:22.029610 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 266/542] 10.222.0.18 () {54 vars in 927 bytes} [Thu Oct 13 10:58:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 10:58:22.041950 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14232064-ed6d-4ca6-9749-e7ac51f4f80e None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:22.042268 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14232064-ed6d-4ca6-9749-e7ac51f4f80e None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:22.042484 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14232064-ed6d-4ca6-9749-e7ac51f4f80e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:22.069699 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-14232064-ed6d-4ca6-9749-e7ac51f4f80e None None] MFA Rules not processed for user `8ba31ade43694cf8bf28f7528a9ea179`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 10:58:22.071460 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-14232064-ed6d-4ca6-9749-e7ac51f4f80e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 10:58:22.083638 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:58:22.093451 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c6480d-b0c9-420a-a498-56a0c3d94eea None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:22.098629 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:58:22.135379 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2767dd-0dbe-4286-b134-190b121ac6ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:22.136244 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2767dd-0dbe-4286-b134-190b121ac6ec None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:22.136806 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2767dd-0dbe-4286-b134-190b121ac6ec None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:22.137393 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2767dd-0dbe-4286-b134-190b121ac6ec None admin] PATH_INFO: `/v3/domains` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:22.138186 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2767dd-0dbe-4286-b134-190b121ac6ec None admin] RBAC: Adding query filter params (name=Default) {{(pid=81533) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 10:58:22.138660 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2767dd-0dbe-4286-b134-190b121ac6ec None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:22.140379 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2767dd-0dbe-4286-b134-190b121ac6ec None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:22.149353 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 267/543] 10.222.0.18 () {58 vars in 1024 bytes} [Thu Oct 13 10:58:22 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 13 10:58:22.164323 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 277/544] 10.222.0.18 () {56 vars in 1109 bytes} [Thu Oct 13 10:58:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 10:58:22.170322 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14232064-ed6d-4ca6-9749-e7ac51f4f80e None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:22.171975 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4569ea-0bec-4a05-ab1f-897ae3d06924 None None] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:22.172336 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4569ea-0bec-4a05-ab1f-897ae3d06924 None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:22.172615 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4569ea-0bec-4a05-ab1f-897ae3d06924 None None] PATH_INFO: `/` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:22.174449 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 278/545] 10.222.0.18 () {54 vars in 927 bytes} [Thu Oct 13 10:58:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 13 10:58:22.181950 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b26c5a-57f9-4b73-93f9-3bd0694696d9 None None] REQUEST_METHOD: `POST` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:22.182234 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b26c5a-57f9-4b73-93f9-3bd0694696d9 None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:22.182511 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b26c5a-57f9-4b73-93f9-3bd0694696d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:22.207804 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.auth.core [None req-f5b26c5a-57f9-4b73-93f9-3bd0694696d9 None None] MFA Rules not processed for user `8ba31ade43694cf8bf28f7528a9ea179`. Rule list: `[]` (Enabled: `True`). {{(pid=81533) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 10:58:22.209030 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-f5b26c5a-57f9-4b73-93f9-3bd0694696d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 10:58:22.283839 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 279/546] 10.222.0.18 () {58 vars in 1024 bytes} [Thu Oct 13 10:58:22 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 13 10:58:22.305278 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14232064-ed6d-4ca6-9749-e7ac51f4f80e None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:22.347689 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d2b3c0-7bac-445e-ab69-f3a0245603e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:22.348336 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d2b3c0-7bac-445e-ab69-f3a0245603e0 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:22.348667 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d2b3c0-7bac-445e-ab69-f3a0245603e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:22.348947 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d2b3c0-7bac-445e-ab69-f3a0245603e0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:22.357086 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d2b3c0-7bac-445e-ab69-f3a0245603e0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:22.358563 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d2b3c0-7bac-445e-ab69-f3a0245603e0 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:22.376343 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application [None req-b8d2b3c0-7bac-445e-ab69-f3a0245603e0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 13 10:58:22.376343 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 10:58:22.376343 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 10:58:22.376343 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 10:58:22.376343 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 10:58:22.376343 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 10:58:22.376343 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 10:58:22.376343 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 10:58:22.376343 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 10:58:22.376343 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 10:58:22.376343 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 10:58:22.376343 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 10:58:22.376343 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 13 10:58:22.376343 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 13 10:58:22.376343 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 13 10:58:22.377291 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 13 10:58:22.377291 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 10:58:22.377291 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 10:58:22.377291 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 10:58:22.377291 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 10:58:22.377291 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 10:58:22.377291 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 10:58:22.377291 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 10:58:22.377291 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application with Lock( Oct 13 10:58:22.377291 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 10:58:22.377291 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._enter() Oct 13 10:58:22.377291 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 10:58:22.377291 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 10:58:22.377291 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 10:58:22.377291 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.creator() Oct 13 10:58:22.377291 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 10:58:22.377291 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application created_value = creator( Oct 13 10:58:22.378202 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 13 10:58:22.378202 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 13 10:58:22.378202 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 13 10:58:22.378202 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 13 10:58:22.378202 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 13 10:58:22.378202 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 13 10:58:22.378202 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 13 10:58:22.378202 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application Oct 13 10:58:22.378202 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 268/547] 10.222.0.18 () {56 vars in 1111 bytes} [Thu Oct 13 10:58:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 13 10:58:22.384110 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b26c5a-57f9-4b73-93f9-3bd0694696d9 None None] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:22.443771 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d2b3c0-7bac-445e-ab69-f3a0245603e0 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:22.475830 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:58:22.505930 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:58:22.528893 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b26c5a-57f9-4b73-93f9-3bd0694696d9 None None] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:22.572053 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab571d2-051d-4915-92e0-c64dbd022701 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:22.572667 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab571d2-051d-4915-92e0-c64dbd022701 None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:22.572942 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab571d2-051d-4915-92e0-c64dbd022701 None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:22.573242 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab571d2-051d-4915-92e0-c64dbd022701 None admin] PATH_INFO: `/v3/projects` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:22.573937 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab571d2-051d-4915-92e0-c64dbd022701 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81533) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 10:58:22.574241 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab571d2-051d-4915-92e0-c64dbd022701 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:22.575669 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab571d2-051d-4915-92e0-c64dbd022701 None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:22.592659 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 280/548] 10.222.0.18 () {56 vars in 1148 bytes} [Thu Oct 13 10:58:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 10:58:22.598927 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab571d2-051d-4915-92e0-c64dbd022701 None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:22.637899 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d2b3c0-7bac-445e-ab69-f3a0245603e0 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:22.684186 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d180039-a1c3-40a0-8289-90a79872a27c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:22.685787 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d180039-a1c3-40a0-8289-90a79872a27c None admin] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:22.686287 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d180039-a1c3-40a0-8289-90a79872a27c None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:22.686772 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d180039-a1c3-40a0-8289-90a79872a27c None admin] PATH_INFO: `/v3/services` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:22.687830 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d180039-a1c3-40a0-8289-90a79872a27c None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:22.689683 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d180039-a1c3-40a0-8289-90a79872a27c None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:22.713400 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 269/549] 10.222.0.18 () {60 vars in 1141 bytes} [Thu Oct 13 10:58:22 2022] POST /identity/v3/services => generated 240 bytes in 270 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 13 10:58:22.715960 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d180039-a1c3-40a0-8289-90a79872a27c None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:22.736844 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab571d2-051d-4915-92e0-c64dbd022701 None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:22.825406 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fddce67e-262e-49c0-abb5-cdc5a280651e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:22.826078 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddce67e-262e-49c0-abb5-cdc5a280651e None admin] REQUEST_METHOD: `PUT` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:22.826356 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddce67e-262e-49c0-abb5-cdc5a280651e None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:22.826630 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddce67e-262e-49c0-abb5-cdc5a280651e None admin] PATH_INFO: `/v3/projects/112613528384453abe7506465609fbd8/users/8fd17114a6034faab30c9003add7199d/roles/30a6d59262144d4d956f4d4207864030` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:22.828632 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fddce67e-262e-49c0-abb5-cdc5a280651e None admin] RBAC: Authorizing `identity:create_grant(project_id=112613528384453abe7506465609fbd8, user_id=8fd17114a6034faab30c9003add7199d, role_id=30a6d59262144d4d956f4d4207864030)` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:22.830132 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fddce67e-262e-49c0-abb5-cdc5a280651e None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:22.846266 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 281/550] 10.222.0.18 () {58 vars in 1439 bytes} [Thu Oct 13 10:58:22 2022] PUT /identity/v3/projects/112613528384453abe7506465609fbd8/users/8fd17114a6034faab30c9003add7199d/roles/30a6d59262144d4d956f4d4207864030 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 13 10:58:22.847622 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f79350c-fd3a-46cc-8413-b7167339c3ce None None] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:22.853603 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f79350c-fd3a-46cc-8413-b7167339c3ce None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:22.853906 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f79350c-fd3a-46cc-8413-b7167339c3ce None None] PATH_INFO: `/` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:22.859807 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 282/551] 10.222.0.18 () {54 vars in 927 bytes} [Thu Oct 13 10:58:22 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 10:58:22.862626 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:58:22.862797 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59c6e89-9617-4a75-b47a-75dfbdcfb7d2 None None] REQUEST_METHOD: `POST` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:22.862983 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59c6e89-9617-4a75-b47a-75dfbdcfb7d2 None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:22.863749 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59c6e89-9617-4a75-b47a-75dfbdcfb7d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:22.878170 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:58:22.895338 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d180039-a1c3-40a0-8289-90a79872a27c None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:22.903721 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.auth.core [None req-a59c6e89-9617-4a75-b47a-75dfbdcfb7d2 None None] MFA Rules not processed for user `8ba31ade43694cf8bf28f7528a9ea179`. Rule list: `[]` (Enabled: `True`). {{(pid=81533) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 10:58:22.910311 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-a59c6e89-9617-4a75-b47a-75dfbdcfb7d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 10:58:22.958221 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0fd621b-a9bc-48e8-b864-956688383ee9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:22.958995 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fd621b-a9bc-48e8-b864-956688383ee9 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:22.959514 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fd621b-a9bc-48e8-b864-956688383ee9 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:22.959869 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fd621b-a9bc-48e8-b864-956688383ee9 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:22.973719 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0fd621b-a9bc-48e8-b864-956688383ee9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 13 10:58:22.987203 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application [None req-f0fd621b-a9bc-48e8-b864-956688383ee9 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 13 10:58:22.987203 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 10:58:22.987203 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 10:58:22.987203 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 10:58:22.987203 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 10:58:22.987203 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 10:58:22.987203 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 10:58:22.987203 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 10:58:22.987203 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 10:58:22.987203 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 10:58:22.987203 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 10:58:22.987203 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 10:58:22.987203 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 13 10:58:22.987203 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 13 10:58:22.987203 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 13 10:58:22.987203 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 13 10:58:22.988208 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 13 10:58:22.988208 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 13 10:58:22.988208 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 13 10:58:22.988208 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 13 10:58:22.988208 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 10:58:22.988208 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 10:58:22.988208 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 10:58:22.988208 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 10:58:22.988208 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 10:58:22.988208 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 10:58:22.988208 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 10:58:22.988208 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application with Lock( Oct 13 10:58:22.988208 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 10:58:22.988208 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._enter() Oct 13 10:58:22.988208 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 10:58:22.988208 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 10:58:22.989078 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 10:58:22.989078 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.creator() Oct 13 10:58:22.989078 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 10:58:22.989078 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application created_value = creator( Oct 13 10:58:22.989078 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 13 10:58:22.989078 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 13 10:58:22.989078 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 13 10:58:22.989078 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 13 10:58:22.989078 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 13 10:58:22.989078 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 13 10:58:22.989078 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 13 10:58:22.989078 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application Oct 13 10:58:22.992745 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 270/552] 10.222.0.18 () {56 vars in 1102 bytes} [Thu Oct 13 10:58:22 2022] GET /identity/v3/roles/service => generated 85 bytes in 277 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 10:58:22.997968 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0fd621b-a9bc-48e8-b864-956688383ee9 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:23.029517 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 283/553] 10.222.0.18 () {58 vars in 1024 bytes} [Thu Oct 13 10:58:22 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 13 10:58:23.112179 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0fd621b-a9bc-48e8-b864-956688383ee9 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:23.147320 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa37d7a7-8ec6-4f86-b778-f598ab94d09b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:23.148473 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa37d7a7-8ec6-4f86-b778-f598ab94d09b None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:23.148773 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa37d7a7-8ec6-4f86-b778-f598ab94d09b None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:23.149071 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa37d7a7-8ec6-4f86-b778-f598ab94d09b None admin] PATH_INFO: `/v3/roles` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:23.149884 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa37d7a7-8ec6-4f86-b778-f598ab94d09b None admin] RBAC: Adding query filter params (name=service) {{(pid=81534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 10:58:23.150188 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa37d7a7-8ec6-4f86-b778-f598ab94d09b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:23.151640 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa37d7a7-8ec6-4f86-b778-f598ab94d09b None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:23.161070 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 271/554] 10.222.0.18 () {56 vars in 1103 bytes} [Thu Oct 13 10:58:22 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 13 10:58:23.166998 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59c6e89-9617-4a75-b47a-75dfbdcfb7d2 None None] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:23.310157 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59c6e89-9617-4a75-b47a-75dfbdcfb7d2 None None] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:23.317551 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa37d7a7-8ec6-4f86-b778-f598ab94d09b None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:23.321414 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:58:23.365836 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:58:23.377720 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4490c5e8-2e58-42fe-98e9-7c013a5a35ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:23.378351 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4490c5e8-2e58-42fe-98e9-7c013a5a35ef None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:23.378621 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4490c5e8-2e58-42fe-98e9-7c013a5a35ef None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:23.378888 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4490c5e8-2e58-42fe-98e9-7c013a5a35ef None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:23.398658 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4490c5e8-2e58-42fe-98e9-7c013a5a35ef None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:23.400471 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4490c5e8-2e58-42fe-98e9-7c013a5a35ef None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:23.431445 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application [None req-4490c5e8-2e58-42fe-98e9-7c013a5a35ef None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 13 10:58:23.431445 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 10:58:23.431445 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 10:58:23.431445 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 10:58:23.431445 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 10:58:23.431445 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 10:58:23.431445 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 10:58:23.431445 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 10:58:23.431445 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 10:58:23.431445 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 10:58:23.431445 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 10:58:23.431445 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 10:58:23.431445 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 13 10:58:23.431445 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 13 10:58:23.431445 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 13 10:58:23.431445 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 13 10:58:23.432493 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 10:58:23.432493 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 10:58:23.432493 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 10:58:23.432493 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 10:58:23.432493 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 10:58:23.432493 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 10:58:23.432493 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 10:58:23.432493 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application with Lock( Oct 13 10:58:23.432493 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 10:58:23.432493 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._enter() Oct 13 10:58:23.432493 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 10:58:23.432493 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 10:58:23.432493 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 10:58:23.432493 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.creator() Oct 13 10:58:23.432493 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 10:58:23.432493 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application created_value = creator( Oct 13 10:58:23.432493 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 13 10:58:23.433475 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 13 10:58:23.433475 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 13 10:58:23.433475 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application Oct 13 10:58:23.433475 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 284/555] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Oct 13 10:58:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 266 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 10:58:23.441994 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4490c5e8-2e58-42fe-98e9-7c013a5a35ef None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:23.481534 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa37d7a7-8ec6-4f86-b778-f598ab94d09b None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:23.526886 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b338477b-59cc-4743-963e-b6db9f12622d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:23.527896 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b338477b-59cc-4743-963e-b6db9f12622d None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:23.529785 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b338477b-59cc-4743-963e-b6db9f12622d None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:23.530283 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b338477b-59cc-4743-963e-b6db9f12622d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:23.550701 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b338477b-59cc-4743-963e-b6db9f12622d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 13 10:58:23.557063 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application [None req-b338477b-59cc-4743-963e-b6db9f12622d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 13 10:58:23.557063 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 10:58:23.557063 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 10:58:23.557063 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 10:58:23.557063 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 10:58:23.557063 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 10:58:23.557063 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 10:58:23.557063 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 10:58:23.557063 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 10:58:23.557063 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 10:58:23.557063 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 10:58:23.557063 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 10:58:23.557063 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 13 10:58:23.557063 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 13 10:58:23.557063 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 13 10:58:23.557063 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 13 10:58:23.558024 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 13 10:58:23.558024 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 13 10:58:23.558024 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 13 10:58:23.558024 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 13 10:58:23.558024 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 10:58:23.558024 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 10:58:23.558024 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 10:58:23.558024 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 10:58:23.558024 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 10:58:23.558024 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 10:58:23.558024 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 10:58:23.558024 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application with Lock( Oct 13 10:58:23.558024 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 10:58:23.558024 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._enter() Oct 13 10:58:23.558024 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 10:58:23.558024 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 10:58:23.558874 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 10:58:23.558874 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.creator() Oct 13 10:58:23.558874 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 10:58:23.558874 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application created_value = creator( Oct 13 10:58:23.558874 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 13 10:58:23.558874 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 13 10:58:23.558874 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 13 10:58:23.558874 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 13 10:58:23.558874 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 13 10:58:23.558874 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 13 10:58:23.558874 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 13 10:58:23.558874 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application Oct 13 10:58:23.561689 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 272/556] 10.222.0.18 () {56 vars in 1096 bytes} [Thu Oct 13 10:58:23 2022] GET /identity/v3/roles/admin => generated 83 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 10:58:23.573304 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b338477b-59cc-4743-963e-b6db9f12622d None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:23.639435 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:58:23.683433 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b338477b-59cc-4743-963e-b6db9f12622d None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:23.688247 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4490c5e8-2e58-42fe-98e9-7c013a5a35ef None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:23.723267 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1265dca1-34e5-453d-88f1-e4a2f46e10d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:23.724574 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1265dca1-34e5-453d-88f1-e4a2f46e10d6 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:23.727196 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1265dca1-34e5-453d-88f1-e4a2f46e10d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:23.727716 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1265dca1-34e5-453d-88f1-e4a2f46e10d6 None admin] PATH_INFO: `/v3/roles` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:23.728679 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1265dca1-34e5-453d-88f1-e4a2f46e10d6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 10:58:23.729240 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1265dca1-34e5-453d-88f1-e4a2f46e10d6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:23.736666 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1265dca1-34e5-453d-88f1-e4a2f46e10d6 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:23.754451 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 273/557] 10.222.0.18 () {56 vars in 1099 bytes} [Thu Oct 13 10:58:23 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 10:58:23.762190 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1265dca1-34e5-453d-88f1-e4a2f46e10d6 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:23.766677 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11faaa0f-6e87-4cef-bc4d-3dd1e053ee4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:23.767295 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11faaa0f-6e87-4cef-bc4d-3dd1e053ee4d None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:23.767573 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11faaa0f-6e87-4cef-bc4d-3dd1e053ee4d None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:23.769000 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11faaa0f-6e87-4cef-bc4d-3dd1e053ee4d None admin] PATH_INFO: `/v3/domains` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:23.769681 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11faaa0f-6e87-4cef-bc4d-3dd1e053ee4d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81533) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 10:58:23.769983 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11faaa0f-6e87-4cef-bc4d-3dd1e053ee4d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:23.771372 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11faaa0f-6e87-4cef-bc4d-3dd1e053ee4d None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:23.799856 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 285/558] 10.222.0.18 () {56 vars in 1109 bytes} [Thu Oct 13 10:58:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 358 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 10:58:23.803686 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11faaa0f-6e87-4cef-bc4d-3dd1e053ee4d None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:23.895752 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1265dca1-34e5-453d-88f1-e4a2f46e10d6 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:23.899846 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:58:23.923824 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:58:23.940162 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d82ca66-2068-4050-9f3f-71d09d47a185 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:23.941650 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d82ca66-2068-4050-9f3f-71d09d47a185 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:23.942293 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d82ca66-2068-4050-9f3f-71d09d47a185 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:23.943334 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d82ca66-2068-4050-9f3f-71d09d47a185 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:23.958278 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d82ca66-2068-4050-9f3f-71d09d47a185 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:23.960360 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d82ca66-2068-4050-9f3f-71d09d47a185 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:23.995616 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application [None req-6d82ca66-2068-4050-9f3f-71d09d47a185 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 13 10:58:23.995616 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 10:58:23.995616 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 10:58:23.995616 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 10:58:23.995616 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 10:58:23.995616 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 10:58:23.995616 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 10:58:23.995616 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 10:58:23.995616 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 10:58:23.995616 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 10:58:23.995616 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 10:58:23.995616 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 10:58:23.995616 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 13 10:58:23.995616 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 13 10:58:23.995616 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 13 10:58:23.995616 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 13 10:58:23.996689 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 10:58:23.996689 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 10:58:23.996689 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 10:58:23.996689 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 10:58:23.996689 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 10:58:23.996689 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 10:58:23.996689 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 10:58:23.996689 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application with Lock( Oct 13 10:58:23.996689 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 10:58:23.996689 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._enter() Oct 13 10:58:23.996689 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 10:58:23.996689 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 10:58:23.996689 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 10:58:23.996689 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.creator() Oct 13 10:58:23.996689 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 10:58:23.996689 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application created_value = creator( Oct 13 10:58:23.996689 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 13 10:58:23.997630 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 13 10:58:23.997630 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 13 10:58:23.997630 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application Oct 13 10:58:24.002595 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 274/559] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Oct 13 10:58:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 10:58:24.006172 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d82ca66-2068-4050-9f3f-71d09d47a185 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:24.026250 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11faaa0f-6e87-4cef-bc4d-3dd1e053ee4d None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:24.104409 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8537e656-6e48-42a5-b7a3-78a96e809ccc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:24.105420 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8537e656-6e48-42a5-b7a3-78a96e809ccc None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:24.105902 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8537e656-6e48-42a5-b7a3-78a96e809ccc None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:24.106395 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8537e656-6e48-42a5-b7a3-78a96e809ccc None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:24.121467 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8537e656-6e48-42a5-b7a3-78a96e809ccc None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:24.123196 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8537e656-6e48-42a5-b7a3-78a96e809ccc None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:24.141685 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application [None req-8537e656-6e48-42a5-b7a3-78a96e809ccc None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 13 10:58:24.141685 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 10:58:24.141685 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 10:58:24.141685 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 10:58:24.141685 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 10:58:24.141685 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 10:58:24.141685 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 10:58:24.141685 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 10:58:24.141685 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 10:58:24.141685 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 10:58:24.141685 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 10:58:24.141685 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 10:58:24.141685 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 13 10:58:24.141685 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 13 10:58:24.141685 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 13 10:58:24.141685 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 13 10:58:24.142660 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 10:58:24.142660 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 10:58:24.142660 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 13 10:58:24.142660 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 13 10:58:24.142660 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 13 10:58:24.142660 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 13 10:58:24.142660 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 10:58:24.142660 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 10:58:24.142660 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 10:58:24.142660 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 10:58:24.142660 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 10:58:24.142660 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application with Lock( Oct 13 10:58:24.142660 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 10:58:24.142660 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._enter() Oct 13 10:58:24.142660 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 10:58:24.142660 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 10:58:24.142660 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 10:58:24.142660 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.creator() Oct 13 10:58:24.143611 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 10:58:24.143611 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application created_value = creator( Oct 13 10:58:24.143611 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 13 10:58:24.143611 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 13 10:58:24.143611 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 13 10:58:24.143611 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 13 10:58:24.143611 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 13 10:58:24.143611 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 13 10:58:24.143611 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 13 10:58:24.143611 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application Oct 13 10:58:24.151053 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d82ca66-2068-4050-9f3f-71d09d47a185 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:24.152393 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 286/560] 10.222.0.18 () {56 vars in 1117 bytes} [Thu Oct 13 10:58:23 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 349 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 10:58:24.157653 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8537e656-6e48-42a5-b7a3-78a96e809ccc None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:24.198656 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96149a1-905f-47d8-ba5f-a76ce1605a55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:24.199294 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96149a1-905f-47d8-ba5f-a76ce1605a55 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:24.199585 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96149a1-905f-47d8-ba5f-a76ce1605a55 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:24.199837 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96149a1-905f-47d8-ba5f-a76ce1605a55 None admin] PATH_INFO: `/v3/domains` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:24.200471 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96149a1-905f-47d8-ba5f-a76ce1605a55 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 10:58:24.200778 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96149a1-905f-47d8-ba5f-a76ce1605a55 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:24.202304 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96149a1-905f-47d8-ba5f-a76ce1605a55 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:24.227880 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 275/561] 10.222.0.18 () {56 vars in 1109 bytes} [Thu Oct 13 10:58:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 10:58:24.233325 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96149a1-905f-47d8-ba5f-a76ce1605a55 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:24.303749 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:58:24.348333 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8537e656-6e48-42a5-b7a3-78a96e809ccc None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:24.355427 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:58:24.428005 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c3f0df-3634-43ce-95cc-51a2b5ab0919 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:24.428663 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c3f0df-3634-43ce-95cc-51a2b5ab0919 None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:24.428944 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c3f0df-3634-43ce-95cc-51a2b5ab0919 None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:24.429578 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c3f0df-3634-43ce-95cc-51a2b5ab0919 None admin] PATH_INFO: `/v3/users` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:24.431740 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c3f0df-3634-43ce-95cc-51a2b5ab0919 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81533) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 10:58:24.432049 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c3f0df-3634-43ce-95cc-51a2b5ab0919 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:24.435680 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c3f0df-3634-43ce-95cc-51a2b5ab0919 None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:24.440966 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96149a1-905f-47d8-ba5f-a76ce1605a55 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:24.463915 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 287/562] 10.222.0.18 () {56 vars in 1149 bytes} [Thu Oct 13 10:58:24 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 306 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 13 10:58:24.469305 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac96a080-ef6e-4a9f-a3c1-ba3c2fa0268d None None] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:24.469609 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac96a080-ef6e-4a9f-a3c1-ba3c2fa0268d None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:24.469892 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac96a080-ef6e-4a9f-a3c1-ba3c2fa0268d None None] PATH_INFO: `/` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:24.471397 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 288/563] 10.222.0.18 () {54 vars in 927 bytes} [Thu Oct 13 10:58:24 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 10:58:24.472618 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac96a080-ef6e-4a9f-a3c1-ba3c2fa0268d None None] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:24.490489 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f7cbf0-eb91-4d71-be59-4c151f812226 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:24.491121 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f7cbf0-eb91-4d71-be59-4c151f812226 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:24.491401 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f7cbf0-eb91-4d71-be59-4c151f812226 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:24.491774 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f7cbf0-eb91-4d71-be59-4c151f812226 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:24.499864 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f7cbf0-eb91-4d71-be59-4c151f812226 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:24.501357 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f7cbf0-eb91-4d71-be59-4c151f812226 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:24.514186 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application [None req-78f7cbf0-eb91-4d71-be59-4c151f812226 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 13 10:58:24.514186 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 10:58:24.514186 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 10:58:24.514186 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 10:58:24.514186 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 10:58:24.514186 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 10:58:24.514186 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 10:58:24.514186 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 10:58:24.514186 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 10:58:24.514186 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 10:58:24.514186 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 10:58:24.514186 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 10:58:24.514186 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 13 10:58:24.514186 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 13 10:58:24.514186 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 13 10:58:24.514186 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 13 10:58:24.515176 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 10:58:24.515176 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 10:58:24.515176 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 13 10:58:24.515176 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 13 10:58:24.515176 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 13 10:58:24.515176 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 13 10:58:24.515176 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 10:58:24.515176 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 10:58:24.515176 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 10:58:24.515176 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 10:58:24.515176 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 10:58:24.515176 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application with Lock( Oct 13 10:58:24.515176 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 10:58:24.515176 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._enter() Oct 13 10:58:24.515176 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 10:58:24.515176 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 10:58:24.515176 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 10:58:24.515176 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.creator() Oct 13 10:58:24.516130 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 10:58:24.516130 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application created_value = creator( Oct 13 10:58:24.516130 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 13 10:58:24.516130 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 13 10:58:24.516130 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 13 10:58:24.516130 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 13 10:58:24.516130 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 13 10:58:24.516130 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 13 10:58:24.516130 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 13 10:58:24.516130 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application Oct 13 10:58:24.516130 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 276/564] 10.222.0.18 () {56 vars in 1093 bytes} [Thu Oct 13 10:58:24 2022] GET /identity/v3/users/nova => generated 82 bytes in 285 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 13 10:58:24.516727 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d436c2c-893f-4665-8ed4-cdf2bae8c28d None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:24.516727 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d436c2c-893f-4665-8ed4-cdf2bae8c28d None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:24.517458 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d436c2c-893f-4665-8ed4-cdf2bae8c28d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:24.536491 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-5d436c2c-893f-4665-8ed4-cdf2bae8c28d None None] MFA Rules not processed for user `8ba31ade43694cf8bf28f7528a9ea179`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 10:58:24.537776 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-5d436c2c-893f-4665-8ed4-cdf2bae8c28d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 10:58:24.609835 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 277/565] 10.222.0.18 () {58 vars in 1024 bytes} [Thu Oct 13 10:58:24 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 13 10:58:24.610897 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d436c2c-893f-4665-8ed4-cdf2bae8c28d None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:24.617686 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac96a080-ef6e-4a9f-a3c1-ba3c2fa0268d None None] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:24.663129 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:58:24.685253 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cefa1088-4fab-451c-a267-9efa9a84521d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:24.685865 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefa1088-4fab-451c-a267-9efa9a84521d None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:24.686149 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefa1088-4fab-451c-a267-9efa9a84521d None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:24.686420 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefa1088-4fab-451c-a267-9efa9a84521d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:24.702797 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cefa1088-4fab-451c-a267-9efa9a84521d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:24.704476 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cefa1088-4fab-451c-a267-9efa9a84521d None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:24.736670 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application [None req-cefa1088-4fab-451c-a267-9efa9a84521d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 13 10:58:24.736670 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 10:58:24.736670 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 10:58:24.736670 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 10:58:24.736670 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 10:58:24.736670 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 10:58:24.736670 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 10:58:24.736670 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 10:58:24.736670 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 10:58:24.736670 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 10:58:24.736670 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 10:58:24.736670 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 10:58:24.736670 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 13 10:58:24.736670 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 13 10:58:24.736670 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 13 10:58:24.736670 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 13 10:58:24.737678 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 10:58:24.737678 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 10:58:24.737678 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 10:58:24.737678 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 10:58:24.737678 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 10:58:24.737678 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 10:58:24.737678 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 10:58:24.737678 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application with Lock( Oct 13 10:58:24.737678 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 10:58:24.737678 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._enter() Oct 13 10:58:24.737678 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 10:58:24.737678 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 10:58:24.737678 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 10:58:24.737678 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.creator() Oct 13 10:58:24.737678 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 10:58:24.737678 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application created_value = creator( Oct 13 10:58:24.737678 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 13 10:58:24.738578 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 13 10:58:24.738578 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 13 10:58:24.738578 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application Oct 13 10:58:24.739459 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 289/566] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Oct 13 10:58:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 266 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 13 10:58:24.746721 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cefa1088-4fab-451c-a267-9efa9a84521d None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:24.781618 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:58:24.802919 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d436c2c-893f-4665-8ed4-cdf2bae8c28d None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:24.883936 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d765bb60-889c-4662-a791-6b4f082e2041 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:24.884554 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d765bb60-889c-4662-a791-6b4f082e2041 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:24.884833 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d765bb60-889c-4662-a791-6b4f082e2041 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:24.885139 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d765bb60-889c-4662-a791-6b4f082e2041 None admin] PATH_INFO: `/v3/users` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:24.885886 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d765bb60-889c-4662-a791-6b4f082e2041 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 10:58:24.886194 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d765bb60-889c-4662-a791-6b4f082e2041 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:24.887646 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d765bb60-889c-4662-a791-6b4f082e2041 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:24.895519 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cefa1088-4fab-451c-a267-9efa9a84521d None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:24.938883 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 278/567] 10.222.0.18 () {56 vars in 1133 bytes} [Thu Oct 13 10:58:24 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 328 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 10:58:24.939787 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fafa8a-0aac-424a-a2a8-c36a50a22f40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:24.940610 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fafa8a-0aac-424a-a2a8-c36a50a22f40 None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:24.941103 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fafa8a-0aac-424a-a2a8-c36a50a22f40 None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:24.941554 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fafa8a-0aac-424a-a2a8-c36a50a22f40 None admin] PATH_INFO: `/v3/domains` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:24.942375 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2fafa8a-0aac-424a-a2a8-c36a50a22f40 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81533) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 10:58:24.943666 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d765bb60-889c-4662-a791-6b4f082e2041 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:24.944332 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2fafa8a-0aac-424a-a2a8-c36a50a22f40 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:24.949314 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2fafa8a-0aac-424a-a2a8-c36a50a22f40 None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:24.964750 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 290/568] 10.222.0.18 () {56 vars in 1109 bytes} [Thu Oct 13 10:58:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 10:58:24.969098 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fafa8a-0aac-424a-a2a8-c36a50a22f40 None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:25.063315 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:58:25.065717 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:58:25.085921 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d765bb60-889c-4662-a791-6b4f082e2041 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:25.098442 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fafa8a-0aac-424a-a2a8-c36a50a22f40 None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:25.127581 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73f9527-cac2-4194-a41b-6fd706d53c97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:25.128777 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73f9527-cac2-4194-a41b-6fd706d53c97 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:25.129286 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73f9527-cac2-4194-a41b-6fd706d53c97 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:25.129740 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73f9527-cac2-4194-a41b-6fd706d53c97 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:25.145478 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d59552-d23b-47ec-a20c-08a4c4ce743c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:25.146203 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d59552-d23b-47ec-a20c-08a4c4ce743c None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:25.146549 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d59552-d23b-47ec-a20c-08a4c4ce743c None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:25.146887 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d59552-d23b-47ec-a20c-08a4c4ce743c None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:25.147862 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d59552-d23b-47ec-a20c-08a4c4ce743c None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:25.150162 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d59552-d23b-47ec-a20c-08a4c4ce743c None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:25.162820 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application [None req-c8d59552-d23b-47ec-a20c-08a4c4ce743c None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 13 10:58:25.162820 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 10:58:25.162820 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 13 10:58:25.162820 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 13 10:58:25.162820 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 13 10:58:25.162820 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 13 10:58:25.162820 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 13 10:58:25.162820 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 13 10:58:25.162820 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 13 10:58:25.162820 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application Oct 13 10:58:25.162820 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 13 10:58:25.162820 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application Oct 13 10:58:25.162820 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 10:58:25.162820 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 10:58:25.162820 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 10:58:25.162820 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 10:58:25.162820 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 10:58:25.164625 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 10:58:25.164625 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 10:58:25.164625 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 10:58:25.164625 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 10:58:25.164625 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 10:58:25.164625 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 10:58:25.164625 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 13 10:58:25.164625 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 13 10:58:25.164625 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 13 10:58:25.164625 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 13 10:58:25.164625 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 10:58:25.164625 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 10:58:25.164625 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 10:58:25.164625 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 10:58:25.164625 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 10:58:25.164625 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 10:58:25.165538 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 10:58:25.165538 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application with Lock( Oct 13 10:58:25.165538 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 10:58:25.165538 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._enter() Oct 13 10:58:25.165538 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 10:58:25.165538 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 10:58:25.165538 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 10:58:25.165538 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.creator() Oct 13 10:58:25.165538 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 10:58:25.165538 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application created_value = creator( Oct 13 10:58:25.165538 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 13 10:58:25.165538 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 13 10:58:25.165538 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 13 10:58:25.165538 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application Oct 13 10:58:25.165538 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 291/569] 10.222.0.18 () {56 vars in 1129 bytes} [Thu Oct 13 10:58:24 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 10:58:25.166357 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d59552-d23b-47ec-a20c-08a4c4ce743c None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:25.218379 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73f9527-cac2-4194-a41b-6fd706d53c97 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:25.219803 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73f9527-cac2-4194-a41b-6fd706d53c97 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:25.298956 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d59552-d23b-47ec-a20c-08a4c4ce743c None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:25.313243 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:58:25.331670 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 279/570] 10.222.0.18 () {58 vars in 1282 bytes} [Thu Oct 13 10:58:24 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 388 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 13 10:58:25.332456 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73f9527-cac2-4194-a41b-6fd706d53c97 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:25.335221 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8170b4e2-ac33-4ff3-af82-53496e73c4de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:25.336750 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8170b4e2-ac33-4ff3-af82-53496e73c4de None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:25.336952 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8170b4e2-ac33-4ff3-af82-53496e73c4de None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:25.337261 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8170b4e2-ac33-4ff3-af82-53496e73c4de None admin] PATH_INFO: `/v3/projects/service` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:25.344433 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8170b4e2-ac33-4ff3-af82-53496e73c4de None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:25.345939 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8170b4e2-ac33-4ff3-af82-53496e73c4de None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:25.347744 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:58:25.359160 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application [None req-8170b4e2-ac33-4ff3-af82-53496e73c4de None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 13 10:58:25.359160 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 10:58:25.359160 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 10:58:25.359160 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 10:58:25.359160 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 10:58:25.359160 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 10:58:25.359160 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 10:58:25.359160 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 10:58:25.359160 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 10:58:25.359160 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 10:58:25.359160 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 10:58:25.359160 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 10:58:25.359160 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 13 10:58:25.359160 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 13 10:58:25.359160 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 13 10:58:25.360589 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 13 10:58:25.360589 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 10:58:25.360589 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 10:58:25.360589 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 10:58:25.360589 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 10:58:25.360589 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 10:58:25.360589 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 10:58:25.360589 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 10:58:25.360589 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application with Lock( Oct 13 10:58:25.360589 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 10:58:25.360589 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._enter() Oct 13 10:58:25.360589 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 10:58:25.360589 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 10:58:25.360589 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 10:58:25.360589 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.creator() Oct 13 10:58:25.360589 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 10:58:25.360589 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application created_value = creator( Oct 13 10:58:25.361516 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 13 10:58:25.361516 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 13 10:58:25.361516 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 13 10:58:25.361516 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 13 10:58:25.361516 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 13 10:58:25.361516 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 13 10:58:25.361516 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 13 10:58:25.361516 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application Oct 13 10:58:25.361516 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 292/571] 10.222.0.18 () {56 vars in 1111 bytes} [Thu Oct 13 10:58:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 10:58:25.361516 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3416b905-75c1-43ef-854d-47c8e7a91637 None None] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:25.362127 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3416b905-75c1-43ef-854d-47c8e7a91637 None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:25.362127 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3416b905-75c1-43ef-854d-47c8e7a91637 None None] PATH_INFO: `/` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:25.365295 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 293/572] 10.222.0.18 () {54 vars in 927 bytes} [Thu Oct 13 10:58:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 10:58:25.366925 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3416b905-75c1-43ef-854d-47c8e7a91637 None None] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:25.455464 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73f9527-cac2-4194-a41b-6fd706d53c97 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:25.481161 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3416b905-75c1-43ef-854d-47c8e7a91637 None None] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:25.490638 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66dc6234-5398-4cf9-88ef-7e7e462ab249 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:25.491240 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66dc6234-5398-4cf9-88ef-7e7e462ab249 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:25.491518 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66dc6234-5398-4cf9-88ef-7e7e462ab249 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:25.492519 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66dc6234-5398-4cf9-88ef-7e7e462ab249 None admin] PATH_INFO: `/v3/services` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:25.493248 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66dc6234-5398-4cf9-88ef-7e7e462ab249 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 10:58:25.493566 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66dc6234-5398-4cf9-88ef-7e7e462ab249 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:25.494994 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66dc6234-5398-4cf9-88ef-7e7e462ab249 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:25.499671 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 280/573] 10.222.0.18 () {56 vars in 1124 bytes} [Thu Oct 13 10:58:25 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 10:58:25.500455 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66dc6234-5398-4cf9-88ef-7e7e462ab249 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:25.523191 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03706a5e-8623-4277-ae88-1937d60c8d47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:25.523824 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03706a5e-8623-4277-ae88-1937d60c8d47 None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:25.524103 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03706a5e-8623-4277-ae88-1937d60c8d47 None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:25.524376 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03706a5e-8623-4277-ae88-1937d60c8d47 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:25.534822 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03706a5e-8623-4277-ae88-1937d60c8d47 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:25.536560 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03706a5e-8623-4277-ae88-1937d60c8d47 None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:25.551802 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:58:25.552655 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application [None req-03706a5e-8623-4277-ae88-1937d60c8d47 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 13 10:58:25.552655 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 10:58:25.552655 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 10:58:25.552655 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 10:58:25.552655 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 10:58:25.552655 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 10:58:25.552655 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 10:58:25.552655 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 10:58:25.552655 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 10:58:25.552655 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 10:58:25.552655 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 10:58:25.552655 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 10:58:25.552655 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 13 10:58:25.552655 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 13 10:58:25.552655 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 13 10:58:25.552655 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 13 10:58:25.553958 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 10:58:25.553958 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 10:58:25.553958 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 10:58:25.553958 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 10:58:25.553958 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 10:58:25.553958 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 10:58:25.553958 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 10:58:25.553958 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application with Lock( Oct 13 10:58:25.553958 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 10:58:25.553958 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._enter() Oct 13 10:58:25.553958 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 10:58:25.553958 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 10:58:25.553958 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 10:58:25.553958 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.creator() Oct 13 10:58:25.553958 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 10:58:25.553958 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application created_value = creator( Oct 13 10:58:25.553958 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 13 10:58:25.560151 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 13 10:58:25.560151 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 13 10:58:25.560151 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application Oct 13 10:58:25.560151 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 294/574] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Oct 13 10:58:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 10:58:25.560151 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c0f053-d022-4024-9273-cb138fa28b43 None None] REQUEST_METHOD: `POST` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:25.560151 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c0f053-d022-4024-9273-cb138fa28b43 None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:25.560151 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c0f053-d022-4024-9273-cb138fa28b43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:25.574500 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.auth.core [None req-48c0f053-d022-4024-9273-cb138fa28b43 None None] MFA Rules not processed for user `8ba31ade43694cf8bf28f7528a9ea179`. Rule list: `[]` (Enabled: `True`). {{(pid=81533) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 10:58:25.575698 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-48c0f053-d022-4024-9273-cb138fa28b43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 10:58:25.603620 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66dc6234-5398-4cf9-88ef-7e7e462ab249 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:25.620149 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:58:25.638015 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738e3f3c-c6c1-4a37-9854-d000df121736 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:25.638658 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738e3f3c-c6c1-4a37-9854-d000df121736 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:25.638899 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738e3f3c-c6c1-4a37-9854-d000df121736 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:25.639170 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738e3f3c-c6c1-4a37-9854-d000df121736 None admin] PATH_INFO: `/v3/projects` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:25.639857 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738e3f3c-c6c1-4a37-9854-d000df121736 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 10:58:25.640164 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738e3f3c-c6c1-4a37-9854-d000df121736 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:25.649836 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 295/575] 10.222.0.18 () {58 vars in 1024 bytes} [Thu Oct 13 10:58:25 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 13 10:58:25.650020 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738e3f3c-c6c1-4a37-9854-d000df121736 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:25.650122 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c0f053-d022-4024-9273-cb138fa28b43 None None] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:25.656664 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 281/576] 10.222.0.18 () {56 vars in 1148 bytes} [Thu Oct 13 10:58:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 10:58:25.657925 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b8b4bc-f975-47af-8b7e-c5ff855e68cb None None] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:25.658207 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b8b4bc-f975-47af-8b7e-c5ff855e68cb None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:25.658480 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b8b4bc-f975-47af-8b7e-c5ff855e68cb None None] PATH_INFO: `/` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:25.664133 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 282/577] 10.222.0.18 () {54 vars in 927 bytes} [Thu Oct 13 10:58:25 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 10:58:25.664133 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b8b4bc-f975-47af-8b7e-c5ff855e68cb None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:25.751766 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c0f053-d022-4024-9273-cb138fa28b43 None None] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:25.777301 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b8b4bc-f975-47af-8b7e-c5ff855e68cb None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:25.787343 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47204e4c-0dc2-4dd4-aa08-ae178c0a325e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:25.787770 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:58:25.787950 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47204e4c-0dc2-4dd4-aa08-ae178c0a325e None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:25.788230 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47204e4c-0dc2-4dd4-aa08-ae178c0a325e None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:25.789037 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47204e4c-0dc2-4dd4-aa08-ae178c0a325e None admin] PATH_INFO: `/v3/services` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:25.789677 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47204e4c-0dc2-4dd4-aa08-ae178c0a325e None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81533) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 10:58:25.790094 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47204e4c-0dc2-4dd4-aa08-ae178c0a325e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:25.791730 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47204e4c-0dc2-4dd4-aa08-ae178c0a325e None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:25.797762 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 296/578] 10.222.0.18 () {56 vars in 1124 bytes} [Thu Oct 13 10:58:25 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 10:58:25.803010 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47204e4c-0dc2-4dd4-aa08-ae178c0a325e None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:25.815396 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd4cd65-84c4-46a0-b148-5f73b69bb4b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:25.816013 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd4cd65-84c4-46a0-b148-5f73b69bb4b3 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:25.816424 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd4cd65-84c4-46a0-b148-5f73b69bb4b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:25.816790 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd4cd65-84c4-46a0-b148-5f73b69bb4b3 None admin] PATH_INFO: `/v3/domains` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:25.817505 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd4cd65-84c4-46a0-b148-5f73b69bb4b3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 10:58:25.817876 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd4cd65-84c4-46a0-b148-5f73b69bb4b3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:25.819323 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd4cd65-84c4-46a0-b148-5f73b69bb4b3 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:25.835988 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 283/579] 10.222.0.18 () {56 vars in 1109 bytes} [Thu Oct 13 10:58:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 10:58:25.835988 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5babaedb-8460-4c2c-aa32-3a5d3ea1601c None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:25.835988 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5babaedb-8460-4c2c-aa32-3a5d3ea1601c None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:25.835988 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5babaedb-8460-4c2c-aa32-3a5d3ea1601c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:25.852046 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-5babaedb-8460-4c2c-aa32-3a5d3ea1601c None None] MFA Rules not processed for user `8ba31ade43694cf8bf28f7528a9ea179`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 10:58:25.853432 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-5babaedb-8460-4c2c-aa32-3a5d3ea1601c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 10:58:25.858066 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:58:25.918632 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47204e4c-0dc2-4dd4-aa08-ae178c0a325e None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:25.923759 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 284/580] 10.222.0.18 () {58 vars in 1024 bytes} [Thu Oct 13 10:58:25 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 13 10:58:25.924599 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5babaedb-8460-4c2c-aa32-3a5d3ea1601c None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:25.965518 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd210298-1b4a-4d59-ba10-210313a6b080 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:25.966175 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd210298-1b4a-4d59-ba10-210313a6b080 None admin] REQUEST_METHOD: `PUT` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:25.966448 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd210298-1b4a-4d59-ba10-210313a6b080 None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:25.966714 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd210298-1b4a-4d59-ba10-210313a6b080 None admin] PATH_INFO: `/v3/projects/112613528384453abe7506465609fbd8/users/ed56f3fe2ddc48ee9882712aadaa2001/roles/6af7358ee6934ea2830749333f35aa5c` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:25.987058 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd210298-1b4a-4d59-ba10-210313a6b080 None admin] RBAC: Authorizing `identity:create_grant(project_id=112613528384453abe7506465609fbd8, user_id=ed56f3fe2ddc48ee9882712aadaa2001, role_id=6af7358ee6934ea2830749333f35aa5c)` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:25.988447 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd210298-1b4a-4d59-ba10-210313a6b080 None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:26.001335 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 297/581] 10.222.0.18 () {58 vars in 1439 bytes} [Thu Oct 13 10:58:25 2022] PUT /identity/v3/projects/112613528384453abe7506465609fbd8/users/ed56f3fe2ddc48ee9882712aadaa2001/roles/6af7358ee6934ea2830749333f35aa5c => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 10:58:26.009481 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd210298-1b4a-4d59-ba10-210313a6b080 None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:26.036621 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:58:26.043189 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5babaedb-8460-4c2c-aa32-3a5d3ea1601c None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:26.084010 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3024f9d-6ff0-4f85-a0c4-e9029fcc58f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:26.084633 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3024f9d-6ff0-4f85-a0c4-e9029fcc58f7 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:26.084909 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3024f9d-6ff0-4f85-a0c4-e9029fcc58f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:26.085224 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3024f9d-6ff0-4f85-a0c4-e9029fcc58f7 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:26.086194 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3024f9d-6ff0-4f85-a0c4-e9029fcc58f7 None admin] RBAC: Adding query filter params (interface=public, service_id=3353b7d8ac2e4c91916ec7d07e65d356, region_id=RegionOne) {{(pid=81534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 10:58:26.086734 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3024f9d-6ff0-4f85-a0c4-e9029fcc58f7 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:26.088226 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3024f9d-6ff0-4f85-a0c4-e9029fcc58f7 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:26.101491 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 285/582] 10.222.0.18 () {56 vars in 1251 bytes} [Thu Oct 13 10:58:25 2022] GET /identity/v3/endpoints?service_id=3353b7d8ac2e4c91916ec7d07e65d356&interface=public®ion_id=RegionOne => generated 194 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 10:58:26.102779 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3024f9d-6ff0-4f85-a0c4-e9029fcc58f7 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:26.147531 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:58:26.162202 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd210298-1b4a-4d59-ba10-210313a6b080 None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:26.212522 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a04685-7993-477a-b889-0fc4794282a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:26.213188 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a04685-7993-477a-b889-0fc4794282a1 None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:26.213470 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a04685-7993-477a-b889-0fc4794282a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:26.213740 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a04685-7993-477a-b889-0fc4794282a1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:26.223834 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3024f9d-6ff0-4f85-a0c4-e9029fcc58f7 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:26.225625 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a04685-7993-477a-b889-0fc4794282a1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:26.227662 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a04685-7993-477a-b889-0fc4794282a1 None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:26.239133 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application [None req-c8a04685-7993-477a-b889-0fc4794282a1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 13 10:58:26.239133 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 10:58:26.239133 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 10:58:26.239133 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 10:58:26.239133 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 10:58:26.239133 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 10:58:26.239133 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 10:58:26.239133 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 10:58:26.239133 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 10:58:26.239133 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 10:58:26.239133 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 10:58:26.239133 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 10:58:26.239133 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 13 10:58:26.239133 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 13 10:58:26.239133 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 13 10:58:26.240060 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 13 10:58:26.240060 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 10:58:26.240060 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 10:58:26.240060 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 10:58:26.240060 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 10:58:26.240060 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 10:58:26.240060 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 10:58:26.240060 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 10:58:26.240060 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application with Lock( Oct 13 10:58:26.240060 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 10:58:26.240060 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._enter() Oct 13 10:58:26.240060 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 10:58:26.240060 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 10:58:26.240060 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 10:58:26.240060 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.creator() Oct 13 10:58:26.240060 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 10:58:26.240060 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application created_value = creator( Oct 13 10:58:26.241242 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 13 10:58:26.241242 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 13 10:58:26.241242 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 13 10:58:26.241242 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 13 10:58:26.241242 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 13 10:58:26.241242 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 13 10:58:26.241242 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 13 10:58:26.241242 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application Oct 13 10:58:26.244722 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 298/583] 10.222.0.18 () {56 vars in 1111 bytes} [Thu Oct 13 10:58:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 10:58:26.245620 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a04685-7993-477a-b889-0fc4794282a1 None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:26.260816 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e9ffe3-39ea-4d74-8eb6-d605bf0dbf14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:26.261477 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e9ffe3-39ea-4d74-8eb6-d605bf0dbf14 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:26.261755 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e9ffe3-39ea-4d74-8eb6-d605bf0dbf14 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:26.262030 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e9ffe3-39ea-4d74-8eb6-d605bf0dbf14 None admin] PATH_INFO: `/v3/services/network` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:26.262614 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e9ffe3-39ea-4d74-8eb6-d605bf0dbf14 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:26.263978 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e9ffe3-39ea-4d74-8eb6-d605bf0dbf14 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:26.272750 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application [None req-82e9ffe3-39ea-4d74-8eb6-d605bf0dbf14 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Oct 13 10:58:26.272750 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 10:58:26.272750 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 13 10:58:26.272750 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 13 10:58:26.272750 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 13 10:58:26.272750 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 13 10:58:26.272750 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 13 10:58:26.272750 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 13 10:58:26.272750 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 13 10:58:26.272750 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application Oct 13 10:58:26.272750 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 13 10:58:26.272750 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application Oct 13 10:58:26.272750 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 10:58:26.272750 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 10:58:26.272750 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 10:58:26.272750 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 10:58:26.272750 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 10:58:26.274407 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 10:58:26.274407 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 10:58:26.274407 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 10:58:26.274407 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 10:58:26.274407 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 10:58:26.274407 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 10:58:26.274407 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 13 10:58:26.274407 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 13 10:58:26.274407 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 13 10:58:26.274407 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 13 10:58:26.274407 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 10:58:26.274407 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 10:58:26.274407 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 10:58:26.274407 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 10:58:26.274407 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 10:58:26.274407 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 10:58:26.278665 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 10:58:26.278665 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application with Lock( Oct 13 10:58:26.278665 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 10:58:26.278665 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._enter() Oct 13 10:58:26.278665 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 10:58:26.278665 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 10:58:26.278665 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 10:58:26.278665 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.creator() Oct 13 10:58:26.278665 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 10:58:26.278665 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application created_value = creator( Oct 13 10:58:26.278665 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 13 10:58:26.278665 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 13 10:58:26.278665 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 13 10:58:26.278665 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application Oct 13 10:58:26.278665 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 286/584] 10.222.0.18 () {56 vars in 1111 bytes} [Thu Oct 13 10:58:26 2022] GET /identity/v3/services/network => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 10:58:26.279593 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e9ffe3-39ea-4d74-8eb6-d605bf0dbf14 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:26.308182 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:58:26.356971 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a04685-7993-477a-b889-0fc4794282a1 None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:26.391173 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e9ffe3-39ea-4d74-8eb6-d605bf0dbf14 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:26.394066 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17416789-e0e7-441f-810c-20ca38102604 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:26.394675 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17416789-e0e7-441f-810c-20ca38102604 None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:26.394953 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17416789-e0e7-441f-810c-20ca38102604 None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:26.395225 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17416789-e0e7-441f-810c-20ca38102604 None admin] PATH_INFO: `/v3/services` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:26.395827 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17416789-e0e7-441f-810c-20ca38102604 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:26.397236 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17416789-e0e7-441f-810c-20ca38102604 None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:26.403296 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 299/585] 10.222.0.18 () {56 vars in 1087 bytes} [Thu Oct 13 10:58:26 2022] GET /identity/v3/services => generated 772 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 10:58:26.403913 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17416789-e0e7-441f-810c-20ca38102604 None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:26.439062 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:58:26.451240 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182c5510-0e2a-46ad-b50e-089d32aa0078 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:26.452007 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182c5510-0e2a-46ad-b50e-089d32aa0078 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:26.452292 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182c5510-0e2a-46ad-b50e-089d32aa0078 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:26.452563 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182c5510-0e2a-46ad-b50e-089d32aa0078 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:26.467885 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182c5510-0e2a-46ad-b50e-089d32aa0078 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 13 10:58:26.474316 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application [None req-182c5510-0e2a-46ad-b50e-089d32aa0078 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 13 10:58:26.474316 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 10:58:26.474316 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 10:58:26.474316 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 10:58:26.474316 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 10:58:26.474316 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 10:58:26.474316 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 10:58:26.474316 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 10:58:26.474316 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 10:58:26.474316 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 10:58:26.474316 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 10:58:26.474316 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 10:58:26.474316 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 13 10:58:26.474316 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 13 10:58:26.474316 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 13 10:58:26.474316 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 13 10:58:26.475554 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 13 10:58:26.475554 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 13 10:58:26.475554 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 13 10:58:26.475554 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 13 10:58:26.475554 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 10:58:26.475554 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 10:58:26.475554 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 10:58:26.475554 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 10:58:26.475554 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 10:58:26.475554 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 10:58:26.475554 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 10:58:26.475554 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application with Lock( Oct 13 10:58:26.475554 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 10:58:26.475554 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._enter() Oct 13 10:58:26.475554 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 10:58:26.475554 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 10:58:26.476819 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 10:58:26.476819 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.creator() Oct 13 10:58:26.476819 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 10:58:26.476819 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application created_value = creator( Oct 13 10:58:26.476819 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 13 10:58:26.476819 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 13 10:58:26.476819 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 13 10:58:26.476819 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 13 10:58:26.476819 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 13 10:58:26.476819 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 13 10:58:26.476819 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 13 10:58:26.476819 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application Oct 13 10:58:26.481226 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 287/586] 10.222.0.18 () {56 vars in 1096 bytes} [Thu Oct 13 10:58:26 2022] GET /identity/v3/roles/admin => generated 83 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 10:58:26.482393 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182c5510-0e2a-46ad-b50e-089d32aa0078 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:26.534663 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17416789-e0e7-441f-810c-20ca38102604 None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:26.574133 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220cc44a-5238-427b-9509-51eb7307f398 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:26.574757 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220cc44a-5238-427b-9509-51eb7307f398 None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:26.575140 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220cc44a-5238-427b-9509-51eb7307f398 None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:26.575420 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220cc44a-5238-427b-9509-51eb7307f398 None admin] PATH_INFO: `/v3/projects` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:26.576224 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220cc44a-5238-427b-9509-51eb7307f398 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81533) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 10:58:26.576535 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220cc44a-5238-427b-9509-51eb7307f398 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:26.578018 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220cc44a-5238-427b-9509-51eb7307f398 None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:26.592760 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 300/587] 10.222.0.18 () {56 vars in 1148 bytes} [Thu Oct 13 10:58:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 10:58:26.593151 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:58:26.594337 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220cc44a-5238-427b-9509-51eb7307f398 None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:26.609853 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182c5510-0e2a-46ad-b50e-089d32aa0078 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:26.653687 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f24c762-4785-4ae6-8b72-a1fddf4af9e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:26.654296 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f24c762-4785-4ae6-8b72-a1fddf4af9e4 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:26.654612 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f24c762-4785-4ae6-8b72-a1fddf4af9e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:26.654849 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f24c762-4785-4ae6-8b72-a1fddf4af9e4 None admin] PATH_INFO: `/v3/services` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:26.655491 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f24c762-4785-4ae6-8b72-a1fddf4af9e4 None admin] RBAC: Adding query filter params (name=network) {{(pid=81534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 10:58:26.655795 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f24c762-4785-4ae6-8b72-a1fddf4af9e4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:26.658014 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f24c762-4785-4ae6-8b72-a1fddf4af9e4 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:26.662116 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 288/588] 10.222.0.18 () {56 vars in 1112 bytes} [Thu Oct 13 10:58:26 2022] GET /identity/v3/services?name=network => generated 124 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 10:58:26.663000 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f24c762-4785-4ae6-8b72-a1fddf4af9e4 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:26.714159 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220cc44a-5238-427b-9509-51eb7307f398 None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:26.717354 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:58:26.772221 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d432e2b-37e3-4263-9fbf-586c0b577616 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:26.773723 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d432e2b-37e3-4263-9fbf-586c0b577616 None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:26.774287 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d432e2b-37e3-4263-9fbf-586c0b577616 None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:26.774712 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d432e2b-37e3-4263-9fbf-586c0b577616 None admin] PATH_INFO: `/v3/roles` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:26.776233 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d432e2b-37e3-4263-9fbf-586c0b577616 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81533) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 10:58:26.776838 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d432e2b-37e3-4263-9fbf-586c0b577616 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:26.778482 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d432e2b-37e3-4263-9fbf-586c0b577616 None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:26.787410 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f24c762-4785-4ae6-8b72-a1fddf4af9e4 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:26.790362 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 301/589] 10.222.0.18 () {56 vars in 1099 bytes} [Thu Oct 13 10:58:26 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 10:58:26.791255 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d432e2b-37e3-4263-9fbf-586c0b577616 None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:26.828544 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2b698d-917d-4e7b-970a-bf5cfcd1e358 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:26.830029 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2b698d-917d-4e7b-970a-bf5cfcd1e358 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:26.830535 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2b698d-917d-4e7b-970a-bf5cfcd1e358 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:26.831012 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2b698d-917d-4e7b-970a-bf5cfcd1e358 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:26.832049 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2b698d-917d-4e7b-970a-bf5cfcd1e358 None admin] RBAC: Adding query filter params (role.id=30a6d59262144d4d956f4d4207864030, scope.project.id=112613528384453abe7506465609fbd8, user.id=bc5b13f97c0e4a31940b5b73a916af29) {{(pid=81534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 10:58:26.832575 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2b698d-917d-4e7b-970a-bf5cfcd1e358 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:26.834590 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2b698d-917d-4e7b-970a-bf5cfcd1e358 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:26.849281 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 289/590] 10.222.0.18 () {56 vars in 1374 bytes} [Thu Oct 13 10:58:26 2022] GET /identity/v3/role_assignments?user.id=bc5b13f97c0e4a31940b5b73a916af29&scope.project.id=112613528384453abe7506465609fbd8&role.id=30a6d59262144d4d956f4d4207864030 => generated 608 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 10:58:26.850795 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2b698d-917d-4e7b-970a-bf5cfcd1e358 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:26.876864 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:58:26.901760 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d432e2b-37e3-4263-9fbf-586c0b577616 None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:26.980083 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211c50f3-0e3a-42f0-9d5c-66d02367069c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:26.982448 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211c50f3-0e3a-42f0-9d5c-66d02367069c None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:26.982960 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211c50f3-0e3a-42f0-9d5c-66d02367069c None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:26.983454 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211c50f3-0e3a-42f0-9d5c-66d02367069c None admin] PATH_INFO: `/v3/services` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:26.984464 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211c50f3-0e3a-42f0-9d5c-66d02367069c None admin] RBAC: Adding query filter params (type=network) {{(pid=81533) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 10:58:26.984985 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211c50f3-0e3a-42f0-9d5c-66d02367069c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:26.987950 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211c50f3-0e3a-42f0-9d5c-66d02367069c None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:27.001264 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 302/591] 10.222.0.18 () {56 vars in 1112 bytes} [Thu Oct 13 10:58:26 2022] GET /identity/v3/services?type=network => generated 350 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 10:58:27.005650 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2b698d-917d-4e7b-970a-bf5cfcd1e358 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:27.007195 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211c50f3-0e3a-42f0-9d5c-66d02367069c None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:27.014160 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:58:27.082734 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97372b7-6943-4a92-a6b1-5813ac8de2d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:27.083843 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97372b7-6943-4a92-a6b1-5813ac8de2d8 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:27.084378 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97372b7-6943-4a92-a6b1-5813ac8de2d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:27.084867 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97372b7-6943-4a92-a6b1-5813ac8de2d8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:27.106747 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97372b7-6943-4a92-a6b1-5813ac8de2d8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:27.110620 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97372b7-6943-4a92-a6b1-5813ac8de2d8 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:27.128474 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application [None req-c97372b7-6943-4a92-a6b1-5813ac8de2d8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 13 10:58:27.128474 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 10:58:27.128474 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 10:58:27.128474 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 10:58:27.128474 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 10:58:27.128474 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 10:58:27.128474 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 10:58:27.128474 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 10:58:27.128474 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 10:58:27.128474 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 10:58:27.128474 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 10:58:27.128474 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 10:58:27.128474 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 13 10:58:27.128474 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 13 10:58:27.128474 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 13 10:58:27.128474 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 13 10:58:27.129514 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 10:58:27.129514 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 10:58:27.129514 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 10:58:27.129514 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 10:58:27.129514 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 10:58:27.129514 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 10:58:27.129514 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 10:58:27.129514 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application with Lock( Oct 13 10:58:27.129514 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 10:58:27.129514 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._enter() Oct 13 10:58:27.129514 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 10:58:27.129514 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 10:58:27.129514 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 10:58:27.129514 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.creator() Oct 13 10:58:27.129514 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 10:58:27.129514 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application created_value = creator( Oct 13 10:58:27.129514 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 13 10:58:27.130456 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 13 10:58:27.130456 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 13 10:58:27.130456 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application Oct 13 10:58:27.130456 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 290/592] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Oct 13 10:58:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 280 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 10:58:27.138416 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97372b7-6943-4a92-a6b1-5813ac8de2d8 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:27.174851 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211c50f3-0e3a-42f0-9d5c-66d02367069c None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:27.215128 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7966895-aa1b-4150-97fe-18cac99ac149 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:27.215744 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7966895-aa1b-4150-97fe-18cac99ac149 None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:27.216019 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7966895-aa1b-4150-97fe-18cac99ac149 None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:27.216286 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7966895-aa1b-4150-97fe-18cac99ac149 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:27.216992 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7966895-aa1b-4150-97fe-18cac99ac149 None admin] RBAC: Adding query filter params (interface=public, service_id=68a6e81bf42a44ff8db0f93d94b5da2f, region_id=RegionOne) {{(pid=81533) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 10:58:27.217492 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7966895-aa1b-4150-97fe-18cac99ac149 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:27.218866 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7966895-aa1b-4150-97fe-18cac99ac149 None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:27.226470 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:58:27.227561 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 303/593] 10.222.0.18 () {56 vars in 1251 bytes} [Thu Oct 13 10:58:27 2022] GET /identity/v3/endpoints?service_id=68a6e81bf42a44ff8db0f93d94b5da2f&interface=public®ion_id=RegionOne => generated 194 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 10:58:27.233692 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7966895-aa1b-4150-97fe-18cac99ac149 None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:27.272711 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97372b7-6943-4a92-a6b1-5813ac8de2d8 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:27.314970 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233ece22-a076-410b-94aa-934a0a59b593 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:27.315938 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233ece22-a076-410b-94aa-934a0a59b593 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:27.316444 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233ece22-a076-410b-94aa-934a0a59b593 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:27.316944 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233ece22-a076-410b-94aa-934a0a59b593 None admin] PATH_INFO: `/v3/domains` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:27.317830 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233ece22-a076-410b-94aa-934a0a59b593 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 10:58:27.318335 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233ece22-a076-410b-94aa-934a0a59b593 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:27.321564 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233ece22-a076-410b-94aa-934a0a59b593 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:27.327401 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:58:27.343020 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 291/594] 10.222.0.18 () {56 vars in 1109 bytes} [Thu Oct 13 10:58:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 13 10:58:27.348226 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233ece22-a076-410b-94aa-934a0a59b593 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:27.393177 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7966895-aa1b-4150-97fe-18cac99ac149 None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:27.493737 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c5ea62-7a52-4912-8124-ecd71ddafe20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:27.494402 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c5ea62-7a52-4912-8124-ecd71ddafe20 None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:27.494664 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c5ea62-7a52-4912-8124-ecd71ddafe20 None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:27.494886 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c5ea62-7a52-4912-8124-ecd71ddafe20 None admin] PATH_INFO: `/v3/services` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:27.495506 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c5ea62-7a52-4912-8124-ecd71ddafe20 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:27.496923 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c5ea62-7a52-4912-8124-ecd71ddafe20 None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:27.502848 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233ece22-a076-410b-94aa-934a0a59b593 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:27.511996 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 304/595] 10.222.0.18 () {56 vars in 1087 bytes} [Thu Oct 13 10:58:27 2022] GET /identity/v3/services => generated 772 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 10:58:27.532837 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:58:27.544750 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a023c64b-5cae-4f0d-a5eb-73e1eff65699 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:27.545833 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a023c64b-5cae-4f0d-a5eb-73e1eff65699 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:27.546319 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a023c64b-5cae-4f0d-a5eb-73e1eff65699 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:27.546796 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a023c64b-5cae-4f0d-a5eb-73e1eff65699 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:27.556559 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a023c64b-5cae-4f0d-a5eb-73e1eff65699 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:27.558471 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a023c64b-5cae-4f0d-a5eb-73e1eff65699 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:27.571631 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application [None req-a023c64b-5cae-4f0d-a5eb-73e1eff65699 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Oct 13 10:58:27.571631 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 10:58:27.571631 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 10:58:27.571631 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 10:58:27.571631 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 10:58:27.571631 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 10:58:27.571631 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 10:58:27.571631 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 10:58:27.571631 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 10:58:27.571631 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 10:58:27.571631 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 10:58:27.571631 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 10:58:27.571631 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 13 10:58:27.571631 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 13 10:58:27.571631 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 13 10:58:27.571631 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 13 10:58:27.572741 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 10:58:27.572741 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 10:58:27.572741 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 13 10:58:27.572741 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 13 10:58:27.572741 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 13 10:58:27.572741 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 13 10:58:27.572741 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 10:58:27.572741 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 10:58:27.572741 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 10:58:27.572741 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 10:58:27.572741 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 10:58:27.572741 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application with Lock( Oct 13 10:58:27.572741 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 10:58:27.572741 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._enter() Oct 13 10:58:27.572741 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 10:58:27.572741 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 10:58:27.572741 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 10:58:27.572741 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.creator() Oct 13 10:58:27.573731 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 10:58:27.573731 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application created_value = creator( Oct 13 10:58:27.573731 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 13 10:58:27.573731 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 13 10:58:27.573731 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 13 10:58:27.573731 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 13 10:58:27.573731 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 13 10:58:27.573731 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 13 10:58:27.573731 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Oct 13 10:58:27.573731 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application Oct 13 10:58:27.576406 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 292/596] 10.222.0.18 () {56 vars in 1096 bytes} [Thu Oct 13 10:58:27 2022] GET /identity/v3/users/swift => generated 83 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 10:58:27.581920 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c5ea62-7a52-4912-8124-ecd71ddafe20 None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:27.746193 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c5ea62-7a52-4912-8124-ecd71ddafe20 None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:27.778542 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:58:27.784177 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526a41ec-8702-4884-9e93-3e2e2bca04ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:27.785355 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526a41ec-8702-4884-9e93-3e2e2bca04ab None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:27.785876 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526a41ec-8702-4884-9e93-3e2e2bca04ab None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:27.786480 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526a41ec-8702-4884-9e93-3e2e2bca04ab None admin] PATH_INFO: `/v3/users` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:27.787207 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526a41ec-8702-4884-9e93-3e2e2bca04ab None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81533) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 10:58:27.787512 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526a41ec-8702-4884-9e93-3e2e2bca04ab None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:27.789026 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526a41ec-8702-4884-9e93-3e2e2bca04ab None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:27.808378 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 305/597] 10.222.0.18 () {56 vars in 1135 bytes} [Thu Oct 13 10:58:27 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 10:58:27.813724 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a023c64b-5cae-4f0d-a5eb-73e1eff65699 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:27.932974 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a023c64b-5cae-4f0d-a5eb-73e1eff65699 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:27.981841 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c7144b-ed81-46d0-a504-ee0a5209d3c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:27.982839 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c7144b-ed81-46d0-a504-ee0a5209d3c8 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:27.983332 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c7144b-ed81-46d0-a504-ee0a5209d3c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:27.983812 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c7144b-ed81-46d0-a504-ee0a5209d3c8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:28.057427 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:58:28.072672 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c7144b-ed81-46d0-a504-ee0a5209d3c8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:28.074152 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c7144b-ed81-46d0-a504-ee0a5209d3c8 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:28.201787 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 293/598] 10.222.0.18 () {58 vars in 1282 bytes} [Thu Oct 13 10:58:27 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 388 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 13 10:58:28.207487 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526a41ec-8702-4884-9e93-3e2e2bca04ab None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:28.323817 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526a41ec-8702-4884-9e93-3e2e2bca04ab None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:28.360479 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709d62b9-64c9-4d50-af40-a28c94a25f23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:28.361177 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709d62b9-64c9-4d50-af40-a28c94a25f23 None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:28.361453 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709d62b9-64c9-4d50-af40-a28c94a25f23 None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:28.361721 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709d62b9-64c9-4d50-af40-a28c94a25f23 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:28.381875 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709d62b9-64c9-4d50-af40-a28c94a25f23 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:28.383515 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709d62b9-64c9-4d50-af40-a28c94a25f23 None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:28.404436 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application [None req-709d62b9-64c9-4d50-af40-a28c94a25f23 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 13 10:58:28.404436 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 10:58:28.404436 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 10:58:28.404436 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 10:58:28.404436 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 10:58:28.404436 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 10:58:28.404436 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 10:58:28.404436 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 10:58:28.404436 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 10:58:28.404436 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 10:58:28.404436 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 10:58:28.404436 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 10:58:28.404436 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 13 10:58:28.404436 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 13 10:58:28.404436 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 13 10:58:28.404436 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 13 10:58:28.405508 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 10:58:28.405508 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 10:58:28.405508 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 10:58:28.405508 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 10:58:28.405508 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 10:58:28.405508 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 10:58:28.405508 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 10:58:28.405508 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application with Lock( Oct 13 10:58:28.405508 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 10:58:28.405508 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._enter() Oct 13 10:58:28.405508 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 10:58:28.405508 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 10:58:28.405508 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 10:58:28.405508 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.creator() Oct 13 10:58:28.405508 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 10:58:28.405508 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application created_value = creator( Oct 13 10:58:28.405508 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 13 10:58:28.406434 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 13 10:58:28.406434 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 13 10:58:28.406434 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application Oct 13 10:58:28.406434 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 306/599] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Oct 13 10:58:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 10:58:28.412454 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c7144b-ed81-46d0-a504-ee0a5209d3c8 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:28.479604 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe7039e-f3a2-46c3-84aa-6587fef9a4a3 None None] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:28.479879 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe7039e-f3a2-46c3-84aa-6587fef9a4a3 None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:28.480153 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe7039e-f3a2-46c3-84aa-6587fef9a4a3 None None] PATH_INFO: `/` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:28.481522 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 307/600] 10.222.0.18 () {54 vars in 927 bytes} [Thu Oct 13 10:58:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 13 10:58:28.497507 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5439a98-b852-4e8f-8227-28bb98636b93 None None] REQUEST_METHOD: `POST` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:28.498114 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5439a98-b852-4e8f-8227-28bb98636b93 None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:28.498114 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5439a98-b852-4e8f-8227-28bb98636b93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:28.524289 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.auth.core [None req-f5439a98-b852-4e8f-8227-28bb98636b93 None None] MFA Rules not processed for user `8ba31ade43694cf8bf28f7528a9ea179`. Rule list: `[]` (Enabled: `True`). {{(pid=81533) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 10:58:28.525511 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-f5439a98-b852-4e8f-8227-28bb98636b93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 10:58:28.545337 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:58:28.566843 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c7144b-ed81-46d0-a504-ee0a5209d3c8 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:28.599244 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:58:28.603253 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0382e244-3769-4cc2-9772-2f782f663cc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:28.603862 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0382e244-3769-4cc2-9772-2f782f663cc1 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:28.604141 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0382e244-3769-4cc2-9772-2f782f663cc1 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:28.604413 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0382e244-3769-4cc2-9772-2f782f663cc1 None admin] PATH_INFO: `/v3/domains` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:28.605082 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0382e244-3769-4cc2-9772-2f782f663cc1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 10:58:28.605387 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0382e244-3769-4cc2-9772-2f782f663cc1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:28.606814 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0382e244-3769-4cc2-9772-2f782f663cc1 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:28.619148 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 294/601] 10.222.0.18 () {56 vars in 1109 bytes} [Thu Oct 13 10:58:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 10:58:28.624608 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0382e244-3769-4cc2-9772-2f782f663cc1 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:28.666388 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 308/602] 10.222.0.18 () {58 vars in 1024 bytes} [Thu Oct 13 10:58:28 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 13 10:58:28.729881 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0382e244-3769-4cc2-9772-2f782f663cc1 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:28.765371 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60e221f-1ede-408e-81fc-f3f058ff07f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:28.765999 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60e221f-1ede-408e-81fc-f3f058ff07f8 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:28.766279 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60e221f-1ede-408e-81fc-f3f058ff07f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:28.766553 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60e221f-1ede-408e-81fc-f3f058ff07f8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:28.773615 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60e221f-1ede-408e-81fc-f3f058ff07f8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:28.775185 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60e221f-1ede-408e-81fc-f3f058ff07f8 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:28.786842 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application [None req-e60e221f-1ede-408e-81fc-f3f058ff07f8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 13 10:58:28.786842 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 10:58:28.786842 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 10:58:28.786842 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 10:58:28.786842 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 10:58:28.786842 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 10:58:28.786842 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 10:58:28.786842 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 10:58:28.786842 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 10:58:28.786842 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 10:58:28.786842 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 10:58:28.786842 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 10:58:28.786842 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 13 10:58:28.786842 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 13 10:58:28.786842 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 13 10:58:28.787784 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 13 10:58:28.787784 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 10:58:28.787784 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 10:58:28.787784 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 10:58:28.787784 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 10:58:28.787784 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 10:58:28.787784 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 10:58:28.787784 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 10:58:28.787784 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application with Lock( Oct 13 10:58:28.787784 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 10:58:28.787784 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._enter() Oct 13 10:58:28.787784 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 10:58:28.787784 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 10:58:28.787784 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 10:58:28.787784 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.creator() Oct 13 10:58:28.787784 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 10:58:28.787784 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application created_value = creator( Oct 13 10:58:28.789274 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 13 10:58:28.789274 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 13 10:58:28.789274 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 13 10:58:28.789274 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 13 10:58:28.789274 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 13 10:58:28.789274 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 13 10:58:28.789274 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 13 10:58:28.789274 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application Oct 13 10:58:28.789274 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 295/603] 10.222.0.18 () {56 vars in 1111 bytes} [Thu Oct 13 10:58:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 13 10:58:28.794584 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5439a98-b852-4e8f-8227-28bb98636b93 None None] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:28.951698 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5439a98-b852-4e8f-8227-28bb98636b93 None None] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:28.987116 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ebc04c-d50e-497f-92de-3281ffdf27bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:28.987725 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ebc04c-d50e-497f-92de-3281ffdf27bb None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:28.988002 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ebc04c-d50e-497f-92de-3281ffdf27bb None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:28.988272 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ebc04c-d50e-497f-92de-3281ffdf27bb None admin] PATH_INFO: `/v3/projects` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:28.988968 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ebc04c-d50e-497f-92de-3281ffdf27bb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81533) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 10:58:28.989295 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ebc04c-d50e-497f-92de-3281ffdf27bb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:28.990809 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ebc04c-d50e-497f-92de-3281ffdf27bb None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:29.003228 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 309/604] 10.222.0.18 () {56 vars in 1148 bytes} [Thu Oct 13 10:58:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 10:58:29.009963 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60e221f-1ede-408e-81fc-f3f058ff07f8 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:29.020058 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:58:29.119088 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60e221f-1ede-408e-81fc-f3f058ff07f8 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:29.154585 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a40126b-47d2-47b0-8f25-75ce4779ef4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:29.155190 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a40126b-47d2-47b0-8f25-75ce4779ef4b None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:29.155464 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a40126b-47d2-47b0-8f25-75ce4779ef4b None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:29.155735 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a40126b-47d2-47b0-8f25-75ce4779ef4b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:29.156459 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a40126b-47d2-47b0-8f25-75ce4779ef4b None admin] RBAC: Adding query filter params (role.id=30a6d59262144d4d956f4d4207864030, scope.project.id=112613528384453abe7506465609fbd8, user.id=8fd17114a6034faab30c9003add7199d) {{(pid=81534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 10:58:29.156765 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a40126b-47d2-47b0-8f25-75ce4779ef4b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:29.158226 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a40126b-47d2-47b0-8f25-75ce4779ef4b None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:29.161637 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ebc04c-d50e-497f-92de-3281ffdf27bb None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:29.165593 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 296/605] 10.222.0.18 () {56 vars in 1374 bytes} [Thu Oct 13 10:58:29 2022] GET /identity/v3/role_assignments?user.id=8fd17114a6034faab30c9003add7199d&scope.project.id=112613528384453abe7506465609fbd8&role.id=30a6d59262144d4d956f4d4207864030 => generated 608 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 10:58:29.223048 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:58:29.246794 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9913a7-7023-442d-a6bf-c61f0ae09da2 None None] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:29.247674 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9913a7-7023-442d-a6bf-c61f0ae09da2 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:29.248163 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9913a7-7023-442d-a6bf-c61f0ae09da2 None None] PATH_INFO: `/` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:29.249990 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 297/606] 10.222.0.18 () {54 vars in 927 bytes} [Thu Oct 13 10:58:29 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 13 10:58:29.256630 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ce94fb-ee79-4031-b20e-dfe82303872f None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:29.257801 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ce94fb-ee79-4031-b20e-dfe82303872f None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:29.258323 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ce94fb-ee79-4031-b20e-dfe82303872f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:29.280387 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-16ce94fb-ee79-4031-b20e-dfe82303872f None None] MFA Rules not processed for user `8ba31ade43694cf8bf28f7528a9ea179`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 10:58:29.282075 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-16ce94fb-ee79-4031-b20e-dfe82303872f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 10:58:29.351726 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ebc04c-d50e-497f-92de-3281ffdf27bb None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:29.418789 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:58:29.421796 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0013de-cc29-4781-99fb-b2b78d082c3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:29.422752 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0013de-cc29-4781-99fb-b2b78d082c3a None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:29.423260 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0013de-cc29-4781-99fb-b2b78d082c3a None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:29.423758 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0013de-cc29-4781-99fb-b2b78d082c3a None admin] PATH_INFO: `/v3/roles/service` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:29.429468 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 298/607] 10.222.0.18 () {58 vars in 1024 bytes} [Thu Oct 13 10:58:29 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 13 10:58:29.446192 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0013de-cc29-4781-99fb-b2b78d082c3a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 13 10:58:29.451456 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application [None req-2a0013de-cc29-4781-99fb-b2b78d082c3a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 13 10:58:29.451456 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 10:58:29.451456 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 10:58:29.451456 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 10:58:29.451456 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 10:58:29.451456 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 10:58:29.451456 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 10:58:29.451456 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 10:58:29.451456 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 10:58:29.451456 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 10:58:29.451456 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 10:58:29.451456 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 10:58:29.451456 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 13 10:58:29.451456 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 13 10:58:29.451456 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 13 10:58:29.451456 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 13 10:58:29.452404 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 13 10:58:29.452404 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 13 10:58:29.452404 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 13 10:58:29.452404 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 13 10:58:29.452404 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 10:58:29.452404 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 10:58:29.452404 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 10:58:29.452404 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 10:58:29.452404 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 10:58:29.452404 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 10:58:29.452404 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 10:58:29.452404 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application with Lock( Oct 13 10:58:29.452404 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 10:58:29.452404 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._enter() Oct 13 10:58:29.452404 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 10:58:29.452404 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 10:58:29.453445 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 10:58:29.453445 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.creator() Oct 13 10:58:29.453445 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 10:58:29.453445 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application created_value = creator( Oct 13 10:58:29.453445 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 13 10:58:29.453445 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 13 10:58:29.453445 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 13 10:58:29.453445 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 13 10:58:29.453445 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 13 10:58:29.453445 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 13 10:58:29.453445 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 13 10:58:29.453445 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application Oct 13 10:58:29.453445 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 310/608] 10.222.0.18 () {56 vars in 1102 bytes} [Thu Oct 13 10:58:29 2022] GET /identity/v3/roles/service => generated 85 bytes in 292 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 13 10:58:29.458913 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ce94fb-ee79-4031-b20e-dfe82303872f None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:29.585658 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ce94fb-ee79-4031-b20e-dfe82303872f None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:29.638616 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec01613-4a9a-4d9b-b032-be5892bb4b3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:29.639596 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec01613-4a9a-4d9b-b032-be5892bb4b3d None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:29.640196 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec01613-4a9a-4d9b-b032-be5892bb4b3d None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:29.640681 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec01613-4a9a-4d9b-b032-be5892bb4b3d None admin] PATH_INFO: `/v3/roles` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:29.641584 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec01613-4a9a-4d9b-b032-be5892bb4b3d None admin] RBAC: Adding query filter params (name=service) {{(pid=81534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 10:58:29.642106 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec01613-4a9a-4d9b-b032-be5892bb4b3d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:29.643667 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec01613-4a9a-4d9b-b032-be5892bb4b3d None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:29.653023 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 299/609] 10.222.0.18 () {56 vars in 1103 bytes} [Thu Oct 13 10:58:29 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 10:58:29.661929 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0013de-cc29-4781-99fb-b2b78d082c3a None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:29.662406 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8b316f-db23-43bb-8a33-b84cc6c501a3 None None] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:29.662693 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8b316f-db23-43bb-8a33-b84cc6c501a3 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:29.662912 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8b316f-db23-43bb-8a33-b84cc6c501a3 None None] PATH_INFO: `/` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:29.665122 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 300/610] 10.222.0.18 () {54 vars in 927 bytes} [Thu Oct 13 10:58:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 10:58:29.670646 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2dfbbb-0aad-4f92-9cd5-708ab09fe0f7 None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:29.670646 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2dfbbb-0aad-4f92-9cd5-708ab09fe0f7 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:29.670962 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2dfbbb-0aad-4f92-9cd5-708ab09fe0f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:29.697712 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-3b2dfbbb-0aad-4f92-9cd5-708ab09fe0f7 None None] MFA Rules not processed for user `8ba31ade43694cf8bf28f7528a9ea179`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 10:58:29.698910 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-3b2dfbbb-0aad-4f92-9cd5-708ab09fe0f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 10:58:29.792180 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:58:29.803642 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 301/611] 10.222.0.18 () {58 vars in 1024 bytes} [Thu Oct 13 10:58:29 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 13 10:58:29.804705 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2dfbbb-0aad-4f92-9cd5-708ab09fe0f7 None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:29.813510 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:58:29.817761 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0013de-cc29-4781-99fb-b2b78d082c3a None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:29.854326 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9d38d6-6242-41f5-acfe-47b2be2ff023 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:29.855226 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9d38d6-6242-41f5-acfe-47b2be2ff023 None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:29.855698 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9d38d6-6242-41f5-acfe-47b2be2ff023 None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:29.856220 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9d38d6-6242-41f5-acfe-47b2be2ff023 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:29.868061 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9d38d6-6242-41f5-acfe-47b2be2ff023 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:29.869933 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9d38d6-6242-41f5-acfe-47b2be2ff023 None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:29.893249 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application [None req-9b9d38d6-6242-41f5-acfe-47b2be2ff023 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 13 10:58:29.893249 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 10:58:29.893249 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 10:58:29.893249 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 10:58:29.893249 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 10:58:29.893249 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 10:58:29.893249 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 10:58:29.893249 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 10:58:29.893249 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 10:58:29.893249 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 10:58:29.893249 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 10:58:29.893249 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 10:58:29.893249 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 13 10:58:29.893249 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 13 10:58:29.893249 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 13 10:58:29.893249 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 13 10:58:29.894454 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 10:58:29.894454 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 10:58:29.894454 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 10:58:29.894454 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 10:58:29.894454 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 10:58:29.894454 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 10:58:29.894454 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 10:58:29.894454 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application with Lock( Oct 13 10:58:29.894454 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 10:58:29.894454 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._enter() Oct 13 10:58:29.894454 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 10:58:29.894454 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 10:58:29.894454 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 10:58:29.894454 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.creator() Oct 13 10:58:29.894454 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 10:58:29.894454 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application created_value = creator( Oct 13 10:58:29.894454 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 13 10:58:29.895550 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 13 10:58:29.895550 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 13 10:58:29.895550 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application Oct 13 10:58:29.895550 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 311/612] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Oct 13 10:58:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 10:58:29.904810 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9d38d6-6242-41f5-acfe-47b2be2ff023 None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:30.019271 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2dfbbb-0aad-4f92-9cd5-708ab09fe0f7 None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:30.044270 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9d38d6-6242-41f5-acfe-47b2be2ff023 None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:30.079864 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe071f2-d7ad-4fac-8878-5adf70db1996 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:30.080785 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe071f2-d7ad-4fac-8878-5adf70db1996 None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:30.081276 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe071f2-d7ad-4fac-8878-5adf70db1996 None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:30.081711 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe071f2-d7ad-4fac-8878-5adf70db1996 None admin] PATH_INFO: `/v3/domains` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:30.082510 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe071f2-d7ad-4fac-8878-5adf70db1996 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81533) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 10:58:30.082981 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe071f2-d7ad-4fac-8878-5adf70db1996 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:30.084625 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe071f2-d7ad-4fac-8878-5adf70db1996 None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:30.098090 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 312/613] 10.222.0.18 () {56 vars in 1109 bytes} [Thu Oct 13 10:58:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 10:58:30.103990 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe071f2-d7ad-4fac-8878-5adf70db1996 None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:30.113412 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:58:30.115209 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbcd1a37-e456-4e74-bbef-506b46209089 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:30.115928 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcd1a37-e456-4e74-bbef-506b46209089 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:30.116305 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcd1a37-e456-4e74-bbef-506b46209089 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:30.117181 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcd1a37-e456-4e74-bbef-506b46209089 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:30.117855 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbcd1a37-e456-4e74-bbef-506b46209089 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:30.121679 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbcd1a37-e456-4e74-bbef-506b46209089 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:30.137153 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application [None req-cbcd1a37-e456-4e74-bbef-506b46209089 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 13 10:58:30.137153 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 10:58:30.137153 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 13 10:58:30.137153 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 13 10:58:30.137153 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 13 10:58:30.137153 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 13 10:58:30.137153 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 13 10:58:30.137153 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 13 10:58:30.137153 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 13 10:58:30.137153 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application Oct 13 10:58:30.137153 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 13 10:58:30.137153 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application Oct 13 10:58:30.137153 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 10:58:30.137153 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 10:58:30.137153 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 10:58:30.137153 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 10:58:30.137153 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 10:58:30.138467 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 10:58:30.138467 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 10:58:30.138467 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 10:58:30.138467 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 10:58:30.138467 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 10:58:30.138467 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 10:58:30.138467 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 13 10:58:30.138467 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 13 10:58:30.138467 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 13 10:58:30.138467 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 13 10:58:30.138467 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 10:58:30.138467 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 10:58:30.138467 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 10:58:30.138467 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 10:58:30.138467 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 10:58:30.138467 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 10:58:30.139528 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 10:58:30.139528 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application with Lock( Oct 13 10:58:30.139528 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 10:58:30.139528 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._enter() Oct 13 10:58:30.139528 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 10:58:30.139528 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 10:58:30.139528 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 10:58:30.139528 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.creator() Oct 13 10:58:30.139528 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 10:58:30.139528 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application created_value = creator( Oct 13 10:58:30.139528 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 13 10:58:30.139528 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 13 10:58:30.139528 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 13 10:58:30.139528 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application Oct 13 10:58:30.145098 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 302/614] 10.222.0.18 () {56 vars in 1129 bytes} [Thu Oct 13 10:58:29 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 339 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 10:58:30.146282 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbcd1a37-e456-4e74-bbef-506b46209089 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:30.209938 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:58:30.232485 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe071f2-d7ad-4fac-8878-5adf70db1996 None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:30.256845 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbcd1a37-e456-4e74-bbef-506b46209089 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:30.271132 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d0111e-0ed6-44e1-a387-c12e24680dd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:30.272130 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d0111e-0ed6-44e1-a387-c12e24680dd9 None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:30.272417 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d0111e-0ed6-44e1-a387-c12e24680dd9 None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:30.272751 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d0111e-0ed6-44e1-a387-c12e24680dd9 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:30.281393 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d0111e-0ed6-44e1-a387-c12e24680dd9 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:30.282890 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d0111e-0ed6-44e1-a387-c12e24680dd9 None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:30.293614 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe74ce90-db25-4413-bddf-b4869d779f01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:30.294238 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe74ce90-db25-4413-bddf-b4869d779f01 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:30.294515 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe74ce90-db25-4413-bddf-b4869d779f01 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:30.294779 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe74ce90-db25-4413-bddf-b4869d779f01 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:30.295178 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application [None req-e0d0111e-0ed6-44e1-a387-c12e24680dd9 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 13 10:58:30.295178 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 10:58:30.295178 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 10:58:30.295178 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 10:58:30.295178 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 10:58:30.295178 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 10:58:30.295178 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 10:58:30.295178 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 10:58:30.295178 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 10:58:30.295178 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 10:58:30.295178 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 10:58:30.295178 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 10:58:30.295178 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 13 10:58:30.295178 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 13 10:58:30.295178 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 13 10:58:30.295178 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 13 10:58:30.296111 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 10:58:30.296111 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 10:58:30.296111 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 13 10:58:30.296111 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 13 10:58:30.296111 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 13 10:58:30.296111 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 13 10:58:30.296111 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 10:58:30.296111 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 10:58:30.296111 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 10:58:30.296111 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 10:58:30.296111 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 10:58:30.296111 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application with Lock( Oct 13 10:58:30.296111 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 10:58:30.296111 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._enter() Oct 13 10:58:30.296111 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 10:58:30.296111 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 10:58:30.296111 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 10:58:30.296111 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.creator() Oct 13 10:58:30.297089 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 10:58:30.297089 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application created_value = creator( Oct 13 10:58:30.297089 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 13 10:58:30.297089 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 13 10:58:30.297089 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 13 10:58:30.297089 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 13 10:58:30.297089 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 13 10:58:30.297089 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 13 10:58:30.297089 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 13 10:58:30.297089 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application Oct 13 10:58:30.297660 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe74ce90-db25-4413-bddf-b4869d779f01 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:30.297660 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe74ce90-db25-4413-bddf-b4869d779f01 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:30.301035 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 313/615] 10.222.0.18 () {56 vars in 1117 bytes} [Thu Oct 13 10:58:30 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 13 10:58:30.301881 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d0111e-0ed6-44e1-a387-c12e24680dd9 None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:30.307976 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application [None req-fe74ce90-db25-4413-bddf-b4869d779f01 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 13 10:58:30.307976 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 10:58:30.307976 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 13 10:58:30.307976 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 13 10:58:30.307976 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 13 10:58:30.307976 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 13 10:58:30.307976 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 13 10:58:30.307976 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 13 10:58:30.307976 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 13 10:58:30.307976 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application Oct 13 10:58:30.307976 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 13 10:58:30.307976 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application Oct 13 10:58:30.307976 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 10:58:30.307976 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 10:58:30.307976 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 10:58:30.307976 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 10:58:30.308968 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 10:58:30.308968 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 10:58:30.308968 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 10:58:30.308968 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 10:58:30.308968 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 10:58:30.308968 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 10:58:30.308968 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 10:58:30.308968 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 13 10:58:30.308968 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 13 10:58:30.308968 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 13 10:58:30.308968 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 13 10:58:30.308968 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 10:58:30.308968 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 10:58:30.308968 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 10:58:30.308968 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 10:58:30.308968 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 10:58:30.308968 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 10:58:30.309964 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 10:58:30.309964 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application with Lock( Oct 13 10:58:30.309964 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 10:58:30.309964 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._enter() Oct 13 10:58:30.309964 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 10:58:30.309964 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 10:58:30.309964 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 10:58:30.309964 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.creator() Oct 13 10:58:30.309964 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 10:58:30.309964 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application created_value = creator( Oct 13 10:58:30.309964 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 13 10:58:30.309964 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 13 10:58:30.309964 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 13 10:58:30.309964 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application Oct 13 10:58:30.313968 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 303/616] 10.222.0.18 () {56 vars in 1132 bytes} [Thu Oct 13 10:58:30 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 10:58:30.315224 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f4a442-1144-465d-b1ed-4135a676b7f4 None None] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:30.315506 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f4a442-1144-465d-b1ed-4135a676b7f4 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:30.315775 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f4a442-1144-465d-b1ed-4135a676b7f4 None None] PATH_INFO: `/` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:30.317051 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 304/617] 10.222.0.18 () {54 vars in 927 bytes} [Thu Oct 13 10:58:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 10:58:30.317733 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f4a442-1144-465d-b1ed-4135a676b7f4 None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:30.373904 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:58:30.420014 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d0111e-0ed6-44e1-a387-c12e24680dd9 None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:30.430674 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f4a442-1144-465d-b1ed-4135a676b7f4 None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:30.453591 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:58:30.453783 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37461499-630b-4608-8540-301758a02d86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:30.454337 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37461499-630b-4608-8540-301758a02d86 None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:30.454613 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37461499-630b-4608-8540-301758a02d86 None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:30.455239 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37461499-630b-4608-8540-301758a02d86 None admin] PATH_INFO: `/v3/services` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:30.455872 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37461499-630b-4608-8540-301758a02d86 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81533) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 10:58:30.456174 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37461499-630b-4608-8540-301758a02d86 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:30.457584 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37461499-630b-4608-8540-301758a02d86 None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:30.462091 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 314/618] 10.222.0.18 () {56 vars in 1124 bytes} [Thu Oct 13 10:58:30 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 10:58:30.462867 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37461499-630b-4608-8540-301758a02d86 None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:30.477369 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e40e10-88ed-432b-81d0-c209593ded5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:30.478173 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e40e10-88ed-432b-81d0-c209593ded5b None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:30.478670 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e40e10-88ed-432b-81d0-c209593ded5b None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:30.479197 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e40e10-88ed-432b-81d0-c209593ded5b None admin] PATH_INFO: `/v3/users` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:30.480233 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e40e10-88ed-432b-81d0-c209593ded5b None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 10:58:30.480684 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e40e10-88ed-432b-81d0-c209593ded5b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:30.482424 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e40e10-88ed-432b-81d0-c209593ded5b None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:30.500857 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 305/619] 10.222.0.18 () {56 vars in 1149 bytes} [Thu Oct 13 10:58:30 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 10:58:30.506635 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd20fdc6-ce29-4a36-b76f-fb196096a33d None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:30.506926 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd20fdc6-ce29-4a36-b76f-fb196096a33d None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:30.507730 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd20fdc6-ce29-4a36-b76f-fb196096a33d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:30.529028 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-cd20fdc6-ce29-4a36-b76f-fb196096a33d None None] MFA Rules not processed for user `8ba31ade43694cf8bf28f7528a9ea179`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 10:58:30.530467 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-cd20fdc6-ce29-4a36-b76f-fb196096a33d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 10:58:30.568818 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37461499-630b-4608-8540-301758a02d86 None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:30.596649 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:58:30.606635 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b10c860-892d-4827-8884-d299a1fbdb0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:30.607237 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b10c860-892d-4827-8884-d299a1fbdb0f None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:30.607574 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b10c860-892d-4827-8884-d299a1fbdb0f None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:30.607846 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b10c860-892d-4827-8884-d299a1fbdb0f None admin] PATH_INFO: `/v3/services` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:30.608324 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 306/620] 10.222.0.18 () {58 vars in 1024 bytes} [Thu Oct 13 10:58:30 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 13 10:58:30.608510 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b10c860-892d-4827-8884-d299a1fbdb0f None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81533) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 10:58:30.608819 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b10c860-892d-4827-8884-d299a1fbdb0f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:30.610241 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b10c860-892d-4827-8884-d299a1fbdb0f None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:30.613923 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd20fdc6-ce29-4a36-b76f-fb196096a33d None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:30.614938 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 315/621] 10.222.0.18 () {56 vars in 1126 bytes} [Thu Oct 13 10:58:30 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 10:58:30.620364 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b10c860-892d-4827-8884-d299a1fbdb0f None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:30.722172 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b10c860-892d-4827-8884-d299a1fbdb0f None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:30.753799 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd20fdc6-ce29-4a36-b76f-fb196096a33d None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:30.768372 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:58:30.769793 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17751055-d4b4-47c6-bcbd-58bd3cf06ce4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:30.770427 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17751055-d4b4-47c6-bcbd-58bd3cf06ce4 None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:30.770720 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17751055-d4b4-47c6-bcbd-58bd3cf06ce4 None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:30.770972 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17751055-d4b4-47c6-bcbd-58bd3cf06ce4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:30.807159 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14af46a2-5931-4314-a421-d0e14a164d88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:30.809131 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14af46a2-5931-4314-a421-d0e14a164d88 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:30.809618 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14af46a2-5931-4314-a421-d0e14a164d88 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:30.810087 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14af46a2-5931-4314-a421-d0e14a164d88 None admin] PATH_INFO: `/v3/services` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:30.810931 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14af46a2-5931-4314-a421-d0e14a164d88 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 10:58:30.811451 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14af46a2-5931-4314-a421-d0e14a164d88 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:30.813783 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14af46a2-5931-4314-a421-d0e14a164d88 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:30.827832 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 307/622] 10.222.0.18 () {56 vars in 1124 bytes} [Thu Oct 13 10:58:30 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 10:58:30.829238 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14af46a2-5931-4314-a421-d0e14a164d88 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:30.838977 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:58:30.850036 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17751055-d4b4-47c6-bcbd-58bd3cf06ce4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:30.852449 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17751055-d4b4-47c6-bcbd-58bd3cf06ce4 None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:30.940676 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14af46a2-5931-4314-a421-d0e14a164d88 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:30.957386 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 316/623] 10.222.0.18 () {58 vars in 1282 bytes} [Thu Oct 13 10:58:30 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 13 10:58:30.958014 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17751055-d4b4-47c6-bcbd-58bd3cf06ce4 None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:30.980638 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d64cd04-f074-4253-95e8-deac8cbe8866 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:30.981200 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d64cd04-f074-4253-95e8-deac8cbe8866 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:30.981485 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d64cd04-f074-4253-95e8-deac8cbe8866 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:30.981745 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d64cd04-f074-4253-95e8-deac8cbe8866 None admin] PATH_INFO: `/v3/services` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:30.982375 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d64cd04-f074-4253-95e8-deac8cbe8866 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 10:58:30.982677 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d64cd04-f074-4253-95e8-deac8cbe8866 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:30.984043 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d64cd04-f074-4253-95e8-deac8cbe8866 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:30.997043 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 308/624] 10.222.0.18 () {56 vars in 1126 bytes} [Thu Oct 13 10:58:30 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 10:58:30.997043 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d64cd04-f074-4253-95e8-deac8cbe8866 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:31.035318 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:58:31.081524 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:58:31.096046 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17751055-d4b4-47c6-bcbd-58bd3cf06ce4 None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:31.119967 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d64cd04-f074-4253-95e8-deac8cbe8866 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:31.141457 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2c9014-8fe2-4a43-b2c1-0940db8d5e4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:31.142087 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2c9014-8fe2-4a43-b2c1-0940db8d5e4c None admin] REQUEST_METHOD: `POST` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:31.142369 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2c9014-8fe2-4a43-b2c1-0940db8d5e4c None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:31.142645 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2c9014-8fe2-4a43-b2c1-0940db8d5e4c None admin] PATH_INFO: `/v3/endpoints` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:31.143625 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e2c9014-8fe2-4a43-b2c1-0940db8d5e4c None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:31.145548 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e2c9014-8fe2-4a43-b2c1-0940db8d5e4c None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:31.170571 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69fbaab3-9616-441b-b7f8-a8dd63aa98c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:31.171331 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fbaab3-9616-441b-b7f8-a8dd63aa98c0 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:31.171746 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fbaab3-9616-441b-b7f8-a8dd63aa98c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:31.172109 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fbaab3-9616-441b-b7f8-a8dd63aa98c0 None admin] PATH_INFO: `/v3/services/network` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:31.172853 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69fbaab3-9616-441b-b7f8-a8dd63aa98c0 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:31.174409 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69fbaab3-9616-441b-b7f8-a8dd63aa98c0 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:31.183120 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 317/625] 10.222.0.18 () {60 vars in 1144 bytes} [Thu Oct 13 10:58:30 2022] POST /identity/v3/endpoints => generated 346 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 13 10:58:31.183120 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2c9014-8fe2-4a43-b2c1-0940db8d5e4c None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:31.197778 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application [None req-69fbaab3-9616-441b-b7f8-a8dd63aa98c0 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Oct 13 10:58:31.197778 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 10:58:31.197778 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 13 10:58:31.197778 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 13 10:58:31.197778 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 13 10:58:31.197778 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 13 10:58:31.197778 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 13 10:58:31.197778 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 13 10:58:31.197778 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 13 10:58:31.197778 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application Oct 13 10:58:31.197778 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 13 10:58:31.197778 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application Oct 13 10:58:31.197778 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 10:58:31.197778 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 10:58:31.197778 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 10:58:31.197778 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 10:58:31.197778 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 10:58:31.198875 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 10:58:31.198875 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 10:58:31.198875 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 10:58:31.198875 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 10:58:31.198875 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 10:58:31.198875 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 10:58:31.198875 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 13 10:58:31.198875 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 13 10:58:31.198875 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 13 10:58:31.198875 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 13 10:58:31.198875 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 10:58:31.198875 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 10:58:31.198875 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 10:58:31.198875 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 10:58:31.198875 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 10:58:31.198875 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 10:58:31.199774 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 10:58:31.199774 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application with Lock( Oct 13 10:58:31.199774 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 10:58:31.199774 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._enter() Oct 13 10:58:31.199774 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 10:58:31.199774 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 10:58:31.199774 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 10:58:31.199774 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.creator() Oct 13 10:58:31.199774 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 10:58:31.199774 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application created_value = creator( Oct 13 10:58:31.199774 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 13 10:58:31.199774 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 13 10:58:31.199774 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 13 10:58:31.199774 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application Oct 13 10:58:31.199774 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 309/626] 10.222.0.18 () {56 vars in 1111 bytes} [Thu Oct 13 10:58:30 2022] GET /identity/v3/services/network => generated 88 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 10:58:31.207152 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69fbaab3-9616-441b-b7f8-a8dd63aa98c0 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:31.385685 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2c9014-8fe2-4a43-b2c1-0940db8d5e4c None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:31.386282 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:58:31.390971 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69fbaab3-9616-441b-b7f8-a8dd63aa98c0 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:31.438258 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c4bca0-c041-4d50-aff7-c4bce8192e5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:31.438904 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c4bca0-c041-4d50-aff7-c4bce8192e5c None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:31.439182 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c4bca0-c041-4d50-aff7-c4bce8192e5c None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:31.439453 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c4bca0-c041-4d50-aff7-c4bce8192e5c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:31.440071 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493d7427-aa64-40e5-a391-2eb87df83d28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:31.440902 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493d7427-aa64-40e5-a391-2eb87df83d28 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:31.441444 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493d7427-aa64-40e5-a391-2eb87df83d28 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:31.441816 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493d7427-aa64-40e5-a391-2eb87df83d28 None admin] PATH_INFO: `/v3/services` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:31.442557 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493d7427-aa64-40e5-a391-2eb87df83d28 None admin] RBAC: Adding query filter params (name=network) {{(pid=81534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 10:58:31.442950 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493d7427-aa64-40e5-a391-2eb87df83d28 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:31.444406 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493d7427-aa64-40e5-a391-2eb87df83d28 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:31.449859 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 310/627] 10.222.0.18 () {56 vars in 1112 bytes} [Thu Oct 13 10:58:31 2022] GET /identity/v3/services?name=network => generated 124 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 10:58:31.453314 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c4bca0-c041-4d50-aff7-c4bce8192e5c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:31.454810 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c4bca0-c041-4d50-aff7-c4bce8192e5c None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:31.455808 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493d7427-aa64-40e5-a391-2eb87df83d28 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:31.457693 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:58:31.481487 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application [None req-15c4bca0-c041-4d50-aff7-c4bce8192e5c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 13 10:58:31.481487 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 10:58:31.481487 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 10:58:31.481487 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 10:58:31.481487 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 10:58:31.481487 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 10:58:31.481487 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 10:58:31.481487 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 10:58:31.481487 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 10:58:31.481487 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 10:58:31.481487 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 10:58:31.481487 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 10:58:31.481487 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 13 10:58:31.481487 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 13 10:58:31.481487 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 13 10:58:31.481487 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 13 10:58:31.482532 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 10:58:31.482532 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 10:58:31.482532 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 10:58:31.482532 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 10:58:31.482532 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 10:58:31.482532 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 10:58:31.482532 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 10:58:31.482532 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application with Lock( Oct 13 10:58:31.482532 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 10:58:31.482532 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._enter() Oct 13 10:58:31.482532 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 10:58:31.482532 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 10:58:31.482532 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 10:58:31.482532 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.creator() Oct 13 10:58:31.482532 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 10:58:31.482532 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application created_value = creator( Oct 13 10:58:31.482532 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 13 10:58:31.483454 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 13 10:58:31.483454 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 13 10:58:31.483454 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application Oct 13 10:58:31.483454 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 318/628] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Oct 13 10:58:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 301 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 10:58:31.489410 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c4bca0-c041-4d50-aff7-c4bce8192e5c None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:31.584079 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493d7427-aa64-40e5-a391-2eb87df83d28 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:31.629103 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c4bca0-c041-4d50-aff7-c4bce8192e5c None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:31.657472 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f5744d-6970-4604-9a18-0d7da9a77eba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:31.658405 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f5744d-6970-4604-9a18-0d7da9a77eba None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:31.658866 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f5744d-6970-4604-9a18-0d7da9a77eba None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:31.659323 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f5744d-6970-4604-9a18-0d7da9a77eba None admin] PATH_INFO: `/v3/services` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:31.660224 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f5744d-6970-4604-9a18-0d7da9a77eba None admin] RBAC: Adding query filter params (type=network) {{(pid=81534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 10:58:31.660705 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f5744d-6970-4604-9a18-0d7da9a77eba None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:31.662260 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f5744d-6970-4604-9a18-0d7da9a77eba None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:31.669361 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b6d1f0-ea14-42e8-ae87-0d35f00f184a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:31.669940 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b6d1f0-ea14-42e8-ae87-0d35f00f184a None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:31.670220 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b6d1f0-ea14-42e8-ae87-0d35f00f184a None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:31.670493 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b6d1f0-ea14-42e8-ae87-0d35f00f184a None admin] PATH_INFO: `/v3/domains` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:31.675498 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b6d1f0-ea14-42e8-ae87-0d35f00f184a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81533) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 10:58:31.675498 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b6d1f0-ea14-42e8-ae87-0d35f00f184a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:31.675498 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b6d1f0-ea14-42e8-ae87-0d35f00f184a None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:31.679846 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 311/629] 10.222.0.18 () {56 vars in 1112 bytes} [Thu Oct 13 10:58:31 2022] GET /identity/v3/services?type=network => generated 350 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 10:58:31.686453 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f5744d-6970-4604-9a18-0d7da9a77eba None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:31.691654 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 319/630] 10.222.0.18 () {56 vars in 1109 bytes} [Thu Oct 13 10:58:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 13 10:58:31.698378 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b6d1f0-ea14-42e8-ae87-0d35f00f184a None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:31.748777 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:58:31.774576 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:58:31.827562 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b6d1f0-ea14-42e8-ae87-0d35f00f184a None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:31.840189 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f5744d-6970-4604-9a18-0d7da9a77eba None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:31.863010 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3c439d-b43a-47ce-a6c9-3b06581bd2a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:31.863786 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3c439d-b43a-47ce-a6c9-3b06581bd2a6 None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:31.864130 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3c439d-b43a-47ce-a6c9-3b06581bd2a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:31.864469 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3c439d-b43a-47ce-a6c9-3b06581bd2a6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:31.871654 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d3c439d-b43a-47ce-a6c9-3b06581bd2a6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:31.873219 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d3c439d-b43a-47ce-a6c9-3b06581bd2a6 None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:31.882913 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35ffeea-8552-4698-a8fe-f7af9d43313f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:31.883645 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35ffeea-8552-4698-a8fe-f7af9d43313f None admin] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:31.883925 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35ffeea-8552-4698-a8fe-f7af9d43313f None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:31.884201 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35ffeea-8552-4698-a8fe-f7af9d43313f None admin] PATH_INFO: `/v3/endpoints` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:31.884884 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e35ffeea-8552-4698-a8fe-f7af9d43313f None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:31.885995 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application [None req-5d3c439d-b43a-47ce-a6c9-3b06581bd2a6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 13 10:58:31.885995 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 10:58:31.885995 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 10:58:31.885995 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 10:58:31.885995 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 10:58:31.885995 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 10:58:31.885995 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 10:58:31.885995 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 10:58:31.885995 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 10:58:31.885995 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 10:58:31.885995 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 10:58:31.885995 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 10:58:31.885995 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 13 10:58:31.885995 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 13 10:58:31.885995 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 13 10:58:31.887404 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 13 10:58:31.887404 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 10:58:31.887404 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 10:58:31.887404 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 10:58:31.887404 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 10:58:31.887404 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 10:58:31.887404 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 10:58:31.887404 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 10:58:31.887404 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application with Lock( Oct 13 10:58:31.887404 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 10:58:31.887404 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._enter() Oct 13 10:58:31.887404 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 10:58:31.887404 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 10:58:31.887404 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 10:58:31.887404 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.creator() Oct 13 10:58:31.887404 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 10:58:31.887404 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application created_value = creator( Oct 13 10:58:31.889398 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 13 10:58:31.889398 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 13 10:58:31.889398 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 13 10:58:31.889398 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 13 10:58:31.889398 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 13 10:58:31.889398 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 13 10:58:31.889398 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 13 10:58:31.889398 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application Oct 13 10:58:31.890387 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e35ffeea-8552-4698-a8fe-f7af9d43313f None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:31.890550 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 320/631] 10.222.0.18 () {56 vars in 1111 bytes} [Thu Oct 13 10:58:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 10:58:31.890550 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71f0c5b-e25a-4f26-9c1e-c3e8804d2d3f None None] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:31.890550 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71f0c5b-e25a-4f26-9c1e-c3e8804d2d3f None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:31.890960 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71f0c5b-e25a-4f26-9c1e-c3e8804d2d3f None None] PATH_INFO: `/` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:31.896445 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 321/632] 10.222.0.18 () {54 vars in 927 bytes} [Thu Oct 13 10:58:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 10:58:31.897327 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71f0c5b-e25a-4f26-9c1e-c3e8804d2d3f None None] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:31.921173 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 312/633] 10.222.0.18 () {60 vars in 1144 bytes} [Thu Oct 13 10:58:31 2022] POST /identity/v3/endpoints => generated 337 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 13 10:58:31.922671 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdce07d8-3f5b-4831-8952-6bbd37590958 None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:31.923007 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdce07d8-3f5b-4831-8952-6bbd37590958 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:31.923324 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdce07d8-3f5b-4831-8952-6bbd37590958 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:31.949077 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-cdce07d8-3f5b-4831-8952-6bbd37590958 None None] MFA Rules not processed for user `8ba31ade43694cf8bf28f7528a9ea179`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 10:58:31.949077 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-cdce07d8-3f5b-4831-8952-6bbd37590958 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 10:58:32.041192 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 313/634] 10.222.0.18 () {58 vars in 1024 bytes} [Thu Oct 13 10:58:31 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 13 10:58:32.078986 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71f0c5b-e25a-4f26-9c1e-c3e8804d2d3f None None] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:32.100030 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:58:32.126991 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98cb59a9-6fbd-4f3d-8daf-674beabd9da0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:32.127987 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cb59a9-6fbd-4f3d-8daf-674beabd9da0 None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:32.128467 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cb59a9-6fbd-4f3d-8daf-674beabd9da0 None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:32.128935 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cb59a9-6fbd-4f3d-8daf-674beabd9da0 None admin] PATH_INFO: `/v3/projects` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:32.129867 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98cb59a9-6fbd-4f3d-8daf-674beabd9da0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81533) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 10:58:32.130390 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98cb59a9-6fbd-4f3d-8daf-674beabd9da0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:32.132148 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98cb59a9-6fbd-4f3d-8daf-674beabd9da0 None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:32.144659 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 322/635] 10.222.0.18 () {56 vars in 1148 bytes} [Thu Oct 13 10:58:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 10:58:32.151065 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdce07d8-3f5b-4831-8952-6bbd37590958 None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:32.165613 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:58:32.262694 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdce07d8-3f5b-4831-8952-6bbd37590958 None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:32.305540 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a37f27e-4015-4a1c-854c-f269466cb863 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:32.306546 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a37f27e-4015-4a1c-854c-f269466cb863 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:32.307029 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a37f27e-4015-4a1c-854c-f269466cb863 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:32.307503 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a37f27e-4015-4a1c-854c-f269466cb863 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:32.308464 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a37f27e-4015-4a1c-854c-f269466cb863 None admin] RBAC: Adding query filter params (role.id=6af7358ee6934ea2830749333f35aa5c, scope.project.id=112613528384453abe7506465609fbd8, user.id=ed56f3fe2ddc48ee9882712aadaa2001) {{(pid=81534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 10:58:32.308993 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a37f27e-4015-4a1c-854c-f269466cb863 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:32.310660 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a37f27e-4015-4a1c-854c-f269466cb863 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:32.317483 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 314/636] 10.222.0.18 () {56 vars in 1374 bytes} [Thu Oct 13 10:58:32 2022] GET /identity/v3/role_assignments?user.id=ed56f3fe2ddc48ee9882712aadaa2001&scope.project.id=112613528384453abe7506465609fbd8&role.id=6af7358ee6934ea2830749333f35aa5c => generated 608 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 10:58:32.376945 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98cb59a9-6fbd-4f3d-8daf-674beabd9da0 None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:32.509299 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98cb59a9-6fbd-4f3d-8daf-674beabd9da0 None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:32.548353 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1064d623-35dd-42f3-8a43-9f404f6aa54b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:32.548906 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1064d623-35dd-42f3-8a43-9f404f6aa54b None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:32.549225 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1064d623-35dd-42f3-8a43-9f404f6aa54b None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:32.549494 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1064d623-35dd-42f3-8a43-9f404f6aa54b None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:32.550075 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1064d623-35dd-42f3-8a43-9f404f6aa54b None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:32.551458 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1064d623-35dd-42f3-8a43-9f404f6aa54b None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:32.560634 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application [None req-1064d623-35dd-42f3-8a43-9f404f6aa54b None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 13 10:58:32.560634 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 10:58:32.560634 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 13 10:58:32.560634 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 13 10:58:32.560634 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 13 10:58:32.560634 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 13 10:58:32.560634 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 13 10:58:32.560634 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 13 10:58:32.560634 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 13 10:58:32.560634 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application Oct 13 10:58:32.560634 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 13 10:58:32.560634 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application Oct 13 10:58:32.560634 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 10:58:32.560634 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 10:58:32.560634 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 10:58:32.560634 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 10:58:32.560634 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 10:58:32.561651 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 10:58:32.561651 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 10:58:32.561651 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 10:58:32.561651 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 10:58:32.561651 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 10:58:32.561651 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 10:58:32.561651 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 13 10:58:32.561651 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 13 10:58:32.561651 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 13 10:58:32.561651 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 13 10:58:32.561651 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 10:58:32.561651 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 10:58:32.561651 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 10:58:32.561651 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 10:58:32.561651 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 10:58:32.561651 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 10:58:32.562517 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 10:58:32.562517 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application with Lock( Oct 13 10:58:32.562517 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 10:58:32.562517 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._enter() Oct 13 10:58:32.562517 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 10:58:32.562517 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 10:58:32.562517 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 10:58:32.562517 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.creator() Oct 13 10:58:32.562517 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 10:58:32.562517 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application created_value = creator( Oct 13 10:58:32.562517 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 13 10:58:32.562517 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 13 10:58:32.562517 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 13 10:58:32.562517 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application Oct 13 10:58:32.562517 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 323/637] 10.222.0.18 () {56 vars in 1126 bytes} [Thu Oct 13 10:58:32 2022] GET /identity/v3/services/object-store => generated 93 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 10:58:32.567592 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a37f27e-4015-4a1c-854c-f269466cb863 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:32.653241 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:58:32.683471 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a37f27e-4015-4a1c-854c-f269466cb863 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:32.718894 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4069cc8-78a9-421b-ad7d-2aa0c422aed6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:32.719849 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4069cc8-78a9-421b-ad7d-2aa0c422aed6 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:32.720356 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4069cc8-78a9-421b-ad7d-2aa0c422aed6 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:32.720826 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4069cc8-78a9-421b-ad7d-2aa0c422aed6 None admin] PATH_INFO: `/v3/services` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:32.721669 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4069cc8-78a9-421b-ad7d-2aa0c422aed6 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 10:58:32.722171 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4069cc8-78a9-421b-ad7d-2aa0c422aed6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:32.723733 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4069cc8-78a9-421b-ad7d-2aa0c422aed6 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:32.733356 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 315/638] 10.222.0.18 () {56 vars in 1122 bytes} [Thu Oct 13 10:58:32 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 10:58:32.738505 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1064d623-35dd-42f3-8a43-9f404f6aa54b None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:32.788211 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:58:32.849750 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1064d623-35dd-42f3-8a43-9f404f6aa54b None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:32.886782 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efdbb634-d819-46ec-9e41-8c6d6e9c8194 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:32.887390 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdbb634-d819-46ec-9e41-8c6d6e9c8194 None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:32.887717 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdbb634-d819-46ec-9e41-8c6d6e9c8194 None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:32.887992 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdbb634-d819-46ec-9e41-8c6d6e9c8194 None admin] PATH_INFO: `/v3/services` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:32.888630 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efdbb634-d819-46ec-9e41-8c6d6e9c8194 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81533) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 10:58:32.888931 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efdbb634-d819-46ec-9e41-8c6d6e9c8194 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:32.890328 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efdbb634-d819-46ec-9e41-8c6d6e9c8194 None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:32.895285 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 324/639] 10.222.0.18 () {56 vars in 1122 bytes} [Thu Oct 13 10:58:32 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 10:58:33.418738 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d802292-2049-49ff-b0f2-727b5a9cda9b None None] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:33.419294 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d802292-2049-49ff-b0f2-727b5a9cda9b None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:33.419294 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d802292-2049-49ff-b0f2-727b5a9cda9b None None] PATH_INFO: `/` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:33.420933 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 316/640] 10.222.0.18 () {54 vars in 927 bytes} [Thu Oct 13 10:58:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 10:58:33.426275 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ef5968-510c-4c3c-b421-d1885f816b93 None None] REQUEST_METHOD: `POST` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:33.426558 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ef5968-510c-4c3c-b421-d1885f816b93 None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:33.426831 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ef5968-510c-4c3c-b421-d1885f816b93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:33.445772 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.auth.core [None req-55ef5968-510c-4c3c-b421-d1885f816b93 None None] MFA Rules not processed for user `8ba31ade43694cf8bf28f7528a9ea179`. Rule list: `[]` (Enabled: `True`). {{(pid=81533) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 10:58:33.446962 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-55ef5968-510c-4c3c-b421-d1885f816b93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 10:58:33.514308 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 325/641] 10.222.0.18 () {58 vars in 1024 bytes} [Thu Oct 13 10:58:33 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 13 10:58:33.796508 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d802292-2049-49ff-b0f2-727b5a9cda9b None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:33.859822 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851e35b8-2ca5-4d93-9cfd-eb29d088e3c9 None None] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:33.860364 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851e35b8-2ca5-4d93-9cfd-eb29d088e3c9 None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:33.860447 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851e35b8-2ca5-4d93-9cfd-eb29d088e3c9 None None] PATH_INFO: `/` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:33.862098 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 326/642] 10.222.0.18 () {54 vars in 927 bytes} [Thu Oct 13 10:58:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 13 10:58:33.867808 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92cca4e-285b-4e1d-9741-8c1e4f375cfb None None] REQUEST_METHOD: `POST` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:33.868267 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92cca4e-285b-4e1d-9741-8c1e4f375cfb None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:33.868545 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92cca4e-285b-4e1d-9741-8c1e4f375cfb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:33.887172 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.auth.core [None req-c92cca4e-285b-4e1d-9741-8c1e4f375cfb None None] MFA Rules not processed for user `8ba31ade43694cf8bf28f7528a9ea179`. Rule list: `[]` (Enabled: `True`). {{(pid=81533) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 10:58:33.888663 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-c92cca4e-285b-4e1d-9741-8c1e4f375cfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 10:58:33.904449 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d802292-2049-49ff-b0f2-727b5a9cda9b None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:33.917049 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:58:33.941858 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbbd361-1239-470b-9737-289327f1a39c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:33.942551 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbbd361-1239-470b-9737-289327f1a39c None admin] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:33.942986 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbbd361-1239-470b-9737-289327f1a39c None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:33.943407 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbbd361-1239-470b-9737-289327f1a39c None admin] PATH_INFO: `/v3/services` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:33.944270 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddbbd361-1239-470b-9737-289327f1a39c None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:33.946173 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddbbd361-1239-470b-9737-289327f1a39c None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:33.956727 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:58:33.965472 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 327/643] 10.222.0.18 () {58 vars in 1024 bytes} [Thu Oct 13 10:58:33 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 13 10:58:33.969312 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 317/644] 10.222.0.18 () {60 vars in 1141 bytes} [Thu Oct 13 10:58:33 2022] POST /identity/v3/services => generated 269 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 13 10:58:34.236090 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92cca4e-285b-4e1d-9741-8c1e4f375cfb None None] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:34.340091 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92cca4e-285b-4e1d-9741-8c1e4f375cfb None None] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:34.382008 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05445ee0-0a48-4e6e-82f8-862826958bda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:34.382656 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05445ee0-0a48-4e6e-82f8-862826958bda None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:34.382935 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05445ee0-0a48-4e6e-82f8-862826958bda None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:34.383206 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05445ee0-0a48-4e6e-82f8-862826958bda None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:34.383792 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05445ee0-0a48-4e6e-82f8-862826958bda None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:34.385184 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05445ee0-0a48-4e6e-82f8-862826958bda None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:34.394166 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application [None req-05445ee0-0a48-4e6e-82f8-862826958bda None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 13 10:58:34.394166 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 10:58:34.394166 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 13 10:58:34.394166 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 13 10:58:34.394166 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 13 10:58:34.394166 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 13 10:58:34.394166 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 13 10:58:34.394166 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 13 10:58:34.394166 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 13 10:58:34.394166 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application Oct 13 10:58:34.394166 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 13 10:58:34.394166 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application Oct 13 10:58:34.394166 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 10:58:34.394166 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 10:58:34.394166 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 10:58:34.394166 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 10:58:34.394166 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 10:58:34.395147 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 10:58:34.395147 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 10:58:34.395147 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 10:58:34.395147 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 10:58:34.395147 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 10:58:34.395147 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 10:58:34.395147 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 13 10:58:34.395147 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 13 10:58:34.395147 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 13 10:58:34.395147 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 13 10:58:34.395147 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 10:58:34.395147 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 10:58:34.395147 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 10:58:34.395147 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 10:58:34.395147 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 10:58:34.395147 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 10:58:34.396002 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 10:58:34.396002 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application with Lock( Oct 13 10:58:34.396002 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 10:58:34.396002 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._enter() Oct 13 10:58:34.396002 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 10:58:34.396002 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 10:58:34.396002 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 10:58:34.396002 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.creator() Oct 13 10:58:34.396002 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 10:58:34.396002 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application created_value = creator( Oct 13 10:58:34.396002 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 13 10:58:34.396002 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 13 10:58:34.396002 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 13 10:58:34.396002 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application Oct 13 10:58:34.396002 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 328/645] 10.222.0.18 () {56 vars in 1114 bytes} [Thu Oct 13 10:58:34 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 10:58:34.402074 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbbd361-1239-470b-9737-289327f1a39c None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:34.512748 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbbd361-1239-470b-9737-289327f1a39c None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:34.551949 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595f264a-9dfd-4f04-a716-0c949dade6ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:34.552951 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595f264a-9dfd-4f04-a716-0c949dade6ce None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:34.553499 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595f264a-9dfd-4f04-a716-0c949dade6ce None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:34.554517 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595f264a-9dfd-4f04-a716-0c949dade6ce None admin] PATH_INFO: `/v3/services` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:34.555559 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595f264a-9dfd-4f04-a716-0c949dade6ce None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 10:58:34.556078 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595f264a-9dfd-4f04-a716-0c949dade6ce None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:34.557783 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595f264a-9dfd-4f04-a716-0c949dade6ce None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:34.563875 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 318/646] 10.222.0.18 () {56 vars in 1114 bytes} [Thu Oct 13 10:58:34 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 10:58:34.570511 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05445ee0-0a48-4e6e-82f8-862826958bda None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:34.598132 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:58:34.658795 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9264abf4-e831-4b88-9e70-94fab68fd616 None None] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:34.659079 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9264abf4-e831-4b88-9e70-94fab68fd616 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:34.659360 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9264abf4-e831-4b88-9e70-94fab68fd616 None None] PATH_INFO: `/` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:34.661102 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 319/647] 10.222.0.18 () {54 vars in 927 bytes} [Thu Oct 13 10:58:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 10:58:34.670114 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671549c9-b67d-4c62-9327-911ab5bc6c5a None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:34.670513 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671549c9-b67d-4c62-9327-911ab5bc6c5a None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:34.670884 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671549c9-b67d-4c62-9327-911ab5bc6c5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:34.682145 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05445ee0-0a48-4e6e-82f8-862826958bda None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:34.692717 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-671549c9-b67d-4c62-9327-911ab5bc6c5a None None] MFA Rules not processed for user `8ba31ade43694cf8bf28f7528a9ea179`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 10:58:34.694087 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-671549c9-b67d-4c62-9327-911ab5bc6c5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 10:58:34.718097 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29f1413-7e04-4eb1-9fdc-3c9e51013327 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:34.718747 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29f1413-7e04-4eb1-9fdc-3c9e51013327 None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:34.719020 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29f1413-7e04-4eb1-9fdc-3c9e51013327 None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:34.719285 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29f1413-7e04-4eb1-9fdc-3c9e51013327 None admin] PATH_INFO: `/v3/services` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:34.719912 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29f1413-7e04-4eb1-9fdc-3c9e51013327 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81533) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 10:58:34.720206 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29f1413-7e04-4eb1-9fdc-3c9e51013327 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:34.721651 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29f1413-7e04-4eb1-9fdc-3c9e51013327 None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:34.727765 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 329/648] 10.222.0.18 () {56 vars in 1114 bytes} [Thu Oct 13 10:58:34 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 10:58:34.783859 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:58:34.785454 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 320/649] 10.222.0.18 () {58 vars in 1024 bytes} [Thu Oct 13 10:58:34 2022] POST /identity/v3/auth/tokens => generated 1271 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 13 10:58:35.061094 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29f1413-7e04-4eb1-9fdc-3c9e51013327 None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:35.107953 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8af57f-3350-4ad5-a788-143a44247ba0 None None] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:35.108177 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8af57f-3350-4ad5-a788-143a44247ba0 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:35.108433 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8af57f-3350-4ad5-a788-143a44247ba0 None None] PATH_INFO: `/` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:35.109974 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 321/650] 10.222.0.18 () {54 vars in 927 bytes} [Thu Oct 13 10:58:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 10:58:35.115070 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a92c48-5f46-472e-a86b-08a76ba9f62c None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:35.115350 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a92c48-5f46-472e-a86b-08a76ba9f62c None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:35.115631 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a92c48-5f46-472e-a86b-08a76ba9f62c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:35.135581 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-36a92c48-5f46-472e-a86b-08a76ba9f62c None None] MFA Rules not processed for user `8ba31ade43694cf8bf28f7528a9ea179`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 10:58:35.136759 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-36a92c48-5f46-472e-a86b-08a76ba9f62c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 10:58:35.158110 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:58:35.174181 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29f1413-7e04-4eb1-9fdc-3c9e51013327 None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:35.215452 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 322/651] 10.222.0.18 () {58 vars in 1024 bytes} [Thu Oct 13 10:58:35 2022] POST /identity/v3/auth/tokens => generated 1271 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 13 10:58:35.221700 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814139f5-2d66-4de9-b4b8-2e07272abaef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:35.225124 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814139f5-2d66-4de9-b4b8-2e07272abaef None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:35.225124 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814139f5-2d66-4de9-b4b8-2e07272abaef None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:35.225124 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814139f5-2d66-4de9-b4b8-2e07272abaef None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:35.236143 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-814139f5-2d66-4de9-b4b8-2e07272abaef None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 13 10:58:35.242590 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application [None req-814139f5-2d66-4de9-b4b8-2e07272abaef None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 13 10:58:35.242590 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 10:58:35.242590 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 10:58:35.242590 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 10:58:35.242590 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 10:58:35.242590 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 10:58:35.242590 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 10:58:35.242590 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 10:58:35.242590 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 10:58:35.242590 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 10:58:35.242590 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 10:58:35.242590 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 10:58:35.242590 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 13 10:58:35.242590 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 13 10:58:35.242590 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 13 10:58:35.242590 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 13 10:58:35.243699 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 13 10:58:35.243699 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 13 10:58:35.243699 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 13 10:58:35.243699 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 13 10:58:35.243699 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 10:58:35.243699 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 10:58:35.243699 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 10:58:35.243699 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 10:58:35.243699 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 10:58:35.243699 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 10:58:35.243699 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 10:58:35.243699 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application with Lock( Oct 13 10:58:35.243699 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 10:58:35.243699 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._enter() Oct 13 10:58:35.243699 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 10:58:35.243699 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 10:58:35.244756 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 10:58:35.244756 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.creator() Oct 13 10:58:35.244756 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 10:58:35.244756 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application created_value = creator( Oct 13 10:58:35.244756 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 13 10:58:35.244756 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 13 10:58:35.244756 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 13 10:58:35.244756 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 13 10:58:35.244756 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 13 10:58:35.244756 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 13 10:58:35.244756 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 13 10:58:35.244756 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application Oct 13 10:58:35.247094 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 330/652] 10.222.0.18 () {56 vars in 1120 bytes} [Thu Oct 13 10:58:35 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 10:58:35.254273 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a92c48-5f46-472e-a86b-08a76ba9f62c None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:35.359254 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a92c48-5f46-472e-a86b-08a76ba9f62c None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:35.383247 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:58:35.395064 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b62d007-77e0-4f30-b9b8-7d1ac998d2ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:35.395672 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b62d007-77e0-4f30-b9b8-7d1ac998d2ca None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:35.395947 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b62d007-77e0-4f30-b9b8-7d1ac998d2ca None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:35.396216 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b62d007-77e0-4f30-b9b8-7d1ac998d2ca None admin] PATH_INFO: `/v3/roles` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:35.396878 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b62d007-77e0-4f30-b9b8-7d1ac998d2ca None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 10:58:35.397209 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b62d007-77e0-4f30-b9b8-7d1ac998d2ca None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:35.399260 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b62d007-77e0-4f30-b9b8-7d1ac998d2ca None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:35.407410 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 323/653] 10.222.0.18 () {56 vars in 1115 bytes} [Thu Oct 13 10:58:35 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 10:58:35.413060 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814139f5-2d66-4de9-b4b8-2e07272abaef None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:35.513890 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b62d007-77e0-4f30-b9b8-7d1ac998d2ca None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:35.516365 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814139f5-2d66-4de9-b4b8-2e07272abaef None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:35.565119 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d279b3ce-d79e-40bb-950d-c1ae0d609a77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:35.566024 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d279b3ce-d79e-40bb-950d-c1ae0d609a77 None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:35.566317 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d279b3ce-d79e-40bb-950d-c1ae0d609a77 None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:35.566589 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d279b3ce-d79e-40bb-950d-c1ae0d609a77 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:35.581244 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d279b3ce-d79e-40bb-950d-c1ae0d609a77 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:35.583240 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d279b3ce-d79e-40bb-950d-c1ae0d609a77 None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:35.592779 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:58:35.601490 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application [None req-d279b3ce-d79e-40bb-950d-c1ae0d609a77 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 13 10:58:35.601490 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 10:58:35.601490 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 10:58:35.601490 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 10:58:35.601490 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 10:58:35.601490 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 10:58:35.601490 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 10:58:35.601490 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 10:58:35.601490 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 10:58:35.601490 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 10:58:35.601490 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 10:58:35.601490 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 10:58:35.601490 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 13 10:58:35.601490 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 13 10:58:35.601490 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 13 10:58:35.601490 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 13 10:58:35.602536 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 10:58:35.602536 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 10:58:35.602536 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 10:58:35.602536 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 10:58:35.602536 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 10:58:35.602536 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 10:58:35.602536 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 10:58:35.602536 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application with Lock( Oct 13 10:58:35.602536 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 10:58:35.602536 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._enter() Oct 13 10:58:35.602536 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 10:58:35.602536 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 10:58:35.602536 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 10:58:35.602536 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.creator() Oct 13 10:58:35.602536 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 10:58:35.602536 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application created_value = creator( Oct 13 10:58:35.602536 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 13 10:58:35.603448 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 13 10:58:35.603448 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 13 10:58:35.603448 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application Oct 13 10:58:35.603448 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 331/654] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Oct 13 10:58:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 10:58:35.609928 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d279b3ce-d79e-40bb-950d-c1ae0d609a77 None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:35.636644 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b62d007-77e0-4f30-b9b8-7d1ac998d2ca None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:35.681435 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332372ba-f958-4666-938b-28d5a3f5211e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:35.682474 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332372ba-f958-4666-938b-28d5a3f5211e None admin] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:35.682960 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332372ba-f958-4666-938b-28d5a3f5211e None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:35.683436 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332372ba-f958-4666-938b-28d5a3f5211e None admin] PATH_INFO: `/v3/services` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:35.684344 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332372ba-f958-4666-938b-28d5a3f5211e None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:35.686004 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332372ba-f958-4666-938b-28d5a3f5211e None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:35.707383 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 324/655] 10.222.0.18 () {60 vars in 1141 bytes} [Thu Oct 13 10:58:35 2022] POST /identity/v3/services => generated 241 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 13 10:58:35.736752 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d279b3ce-d79e-40bb-950d-c1ae0d609a77 None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:35.784957 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff24fca-2775-4a07-9683-2ce0422bb730 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:35.785651 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff24fca-2775-4a07-9683-2ce0422bb730 None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:35.785929 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff24fca-2775-4a07-9683-2ce0422bb730 None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:35.786198 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff24fca-2775-4a07-9683-2ce0422bb730 None admin] PATH_INFO: `/v3/domains` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:35.786900 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff24fca-2775-4a07-9683-2ce0422bb730 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81533) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 10:58:35.787252 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff24fca-2775-4a07-9683-2ce0422bb730 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:35.789228 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff24fca-2775-4a07-9683-2ce0422bb730 None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:35.803630 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 332/656] 10.222.0.18 () {56 vars in 1109 bytes} [Thu Oct 13 10:58:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 10:58:35.809025 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332372ba-f958-4666-938b-28d5a3f5211e None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:35.862121 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:58:35.922861 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332372ba-f958-4666-938b-28d5a3f5211e None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:35.958348 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0af20ca-ac06-4702-83b1-bde21be2d7fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:35.959027 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0af20ca-ac06-4702-83b1-bde21be2d7fd None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:35.959306 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0af20ca-ac06-4702-83b1-bde21be2d7fd None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:35.959574 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0af20ca-ac06-4702-83b1-bde21be2d7fd None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:35.967856 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0af20ca-ac06-4702-83b1-bde21be2d7fd None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:35.969311 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0af20ca-ac06-4702-83b1-bde21be2d7fd None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:35.981476 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application [None req-a0af20ca-ac06-4702-83b1-bde21be2d7fd None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 13 10:58:35.981476 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 10:58:35.981476 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 10:58:35.981476 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 10:58:35.981476 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 10:58:35.981476 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 10:58:35.981476 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 10:58:35.981476 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 10:58:35.981476 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 10:58:35.981476 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 10:58:35.981476 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 10:58:35.981476 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 10:58:35.981476 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 13 10:58:35.981476 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 13 10:58:35.981476 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 13 10:58:35.981476 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 13 10:58:35.982491 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 10:58:35.982491 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 10:58:35.982491 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 13 10:58:35.982491 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 13 10:58:35.982491 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 13 10:58:35.982491 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 13 10:58:35.982491 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 10:58:35.982491 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 10:58:35.982491 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 10:58:35.982491 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 10:58:35.982491 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 10:58:35.982491 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application with Lock( Oct 13 10:58:35.982491 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 10:58:35.982491 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._enter() Oct 13 10:58:35.982491 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 10:58:35.982491 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 10:58:35.982491 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 10:58:35.982491 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.creator() Oct 13 10:58:35.984036 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 10:58:35.984036 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application created_value = creator( Oct 13 10:58:35.984036 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 13 10:58:35.984036 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 13 10:58:35.984036 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 13 10:58:35.984036 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 13 10:58:35.984036 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 13 10:58:35.984036 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 13 10:58:35.984036 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 13 10:58:35.984036 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application Oct 13 10:58:35.984036 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 325/657] 10.222.0.18 () {56 vars in 1117 bytes} [Thu Oct 13 10:58:35 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 13 10:58:35.988340 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff24fca-2775-4a07-9683-2ce0422bb730 None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:36.047923 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:58:36.094667 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff24fca-2775-4a07-9683-2ce0422bb730 None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:36.134979 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861c09ac-bd79-40e4-9e5c-622e51b63ae3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:36.135511 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861c09ac-bd79-40e4-9e5c-622e51b63ae3 None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:36.135789 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861c09ac-bd79-40e4-9e5c-622e51b63ae3 None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:36.136060 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861c09ac-bd79-40e4-9e5c-622e51b63ae3 None admin] PATH_INFO: `/v3/users` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:36.136789 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861c09ac-bd79-40e4-9e5c-622e51b63ae3 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81533) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 10:58:36.137118 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861c09ac-bd79-40e4-9e5c-622e51b63ae3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:36.138556 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861c09ac-bd79-40e4-9e5c-622e51b63ae3 None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:36.157060 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 333/658] 10.222.0.18 () {56 vars in 1149 bytes} [Thu Oct 13 10:58:35 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 10:58:36.162794 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0af20ca-ac06-4702-83b1-bde21be2d7fd None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:36.269316 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0af20ca-ac06-4702-83b1-bde21be2d7fd None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:36.272077 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:58:36.306469 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516fc35d-8f08-4867-848b-727312dc26e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:36.307100 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516fc35d-8f08-4867-848b-727312dc26e2 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:36.307376 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516fc35d-8f08-4867-848b-727312dc26e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:36.307644 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516fc35d-8f08-4867-848b-727312dc26e2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:36.317991 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516fc35d-8f08-4867-848b-727312dc26e2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:36.319956 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516fc35d-8f08-4867-848b-727312dc26e2 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:36.334732 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application [None req-516fc35d-8f08-4867-848b-727312dc26e2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 13 10:58:36.334732 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 10:58:36.334732 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 10:58:36.334732 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 10:58:36.334732 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 10:58:36.334732 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 10:58:36.334732 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 10:58:36.334732 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 10:58:36.334732 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 10:58:36.334732 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 10:58:36.334732 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 10:58:36.334732 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 10:58:36.334732 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 13 10:58:36.334732 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 13 10:58:36.334732 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 13 10:58:36.334732 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 13 10:58:36.335813 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 10:58:36.335813 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 10:58:36.335813 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 10:58:36.335813 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 10:58:36.335813 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 10:58:36.335813 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 10:58:36.335813 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 10:58:36.335813 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application with Lock( Oct 13 10:58:36.335813 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 10:58:36.335813 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._enter() Oct 13 10:58:36.335813 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 10:58:36.335813 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 10:58:36.335813 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 10:58:36.335813 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.creator() Oct 13 10:58:36.335813 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 10:58:36.335813 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application created_value = creator( Oct 13 10:58:36.335813 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 13 10:58:36.337086 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 13 10:58:36.337086 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 13 10:58:36.337086 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application Oct 13 10:58:36.337086 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 326/659] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Oct 13 10:58:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 10:58:36.341375 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516fc35d-8f08-4867-848b-727312dc26e2 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:36.342184 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fdfa07-cce0-4d97-aeab-24fa83354a2b None None] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:36.342668 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fdfa07-cce0-4d97-aeab-24fa83354a2b None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:36.343131 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fdfa07-cce0-4d97-aeab-24fa83354a2b None None] PATH_INFO: `/` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:36.348544 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 334/660] 10.222.0.18 () {54 vars in 927 bytes} [Thu Oct 13 10:58:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 10:58:36.350055 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d23ae65-b35e-4087-bb13-7e54e8c52855 None None] REQUEST_METHOD: `POST` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:36.350334 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d23ae65-b35e-4087-bb13-7e54e8c52855 None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:36.350601 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d23ae65-b35e-4087-bb13-7e54e8c52855 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:36.370646 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.auth.core [None req-2d23ae65-b35e-4087-bb13-7e54e8c52855 None None] MFA Rules not processed for user `8ba31ade43694cf8bf28f7528a9ea179`. Rule list: `[]` (Enabled: `True`). {{(pid=81533) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 10:58:36.371839 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-2d23ae65-b35e-4087-bb13-7e54e8c52855 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 10:58:36.446751 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 335/661] 10.222.0.18 () {58 vars in 1024 bytes} [Thu Oct 13 10:58:36 2022] POST /identity/v3/auth/tokens => generated 1373 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 13 10:58:36.467640 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516fc35d-8f08-4867-848b-727312dc26e2 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:36.502541 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb55a19-d326-4695-a23c-75b7788f5c46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:36.503505 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb55a19-d326-4695-a23c-75b7788f5c46 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:36.503984 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb55a19-d326-4695-a23c-75b7788f5c46 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:36.504479 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb55a19-d326-4695-a23c-75b7788f5c46 None admin] PATH_INFO: `/v3/domains` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:36.505365 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb55a19-d326-4695-a23c-75b7788f5c46 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 10:58:36.505883 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb55a19-d326-4695-a23c-75b7788f5c46 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:36.508235 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb55a19-d326-4695-a23c-75b7788f5c46 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:36.521121 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 327/662] 10.222.0.18 () {56 vars in 1109 bytes} [Thu Oct 13 10:58:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 10:58:36.533038 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d23ae65-b35e-4087-bb13-7e54e8c52855 None None] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:36.577525 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:58:36.636011 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d23ae65-b35e-4087-bb13-7e54e8c52855 None None] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:36.671343 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527ff3a2-4798-4b4b-996d-769e92626c6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:36.672198 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527ff3a2-4798-4b4b-996d-769e92626c6d None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:36.672645 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527ff3a2-4798-4b4b-996d-769e92626c6d None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:36.673081 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527ff3a2-4798-4b4b-996d-769e92626c6d None admin] PATH_INFO: `/v3/projects/service` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:36.680746 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527ff3a2-4798-4b4b-996d-769e92626c6d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:36.682383 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527ff3a2-4798-4b4b-996d-769e92626c6d None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:36.694288 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application [None req-527ff3a2-4798-4b4b-996d-769e92626c6d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 13 10:58:36.694288 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 10:58:36.694288 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 10:58:36.694288 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 10:58:36.694288 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 10:58:36.694288 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 10:58:36.694288 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 10:58:36.694288 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 10:58:36.694288 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 10:58:36.694288 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 10:58:36.694288 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 10:58:36.694288 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 10:58:36.694288 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 13 10:58:36.694288 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 13 10:58:36.694288 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 13 10:58:36.695628 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 13 10:58:36.695628 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 10:58:36.695628 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 10:58:36.695628 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 10:58:36.695628 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 10:58:36.695628 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 10:58:36.695628 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 10:58:36.695628 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 10:58:36.695628 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application with Lock( Oct 13 10:58:36.695628 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 10:58:36.695628 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._enter() Oct 13 10:58:36.695628 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 10:58:36.695628 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 10:58:36.695628 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 10:58:36.695628 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.creator() Oct 13 10:58:36.695628 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 10:58:36.695628 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application created_value = creator( Oct 13 10:58:36.696736 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 13 10:58:36.696736 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 13 10:58:36.696736 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 13 10:58:36.696736 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 13 10:58:36.696736 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 13 10:58:36.696736 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 13 10:58:36.696736 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 13 10:58:36.696736 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application Oct 13 10:58:36.699008 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 336/663] 10.222.0.18 () {56 vars in 1111 bytes} [Thu Oct 13 10:58:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 10:58:36.706561 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb55a19-d326-4695-a23c-75b7788f5c46 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:36.729806 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:58:36.747507 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527ff3a2-4798-4b4b-996d-769e92626c6d None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:36.819824 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb55a19-d326-4695-a23c-75b7788f5c46 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:36.861954 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd35652c-b84a-451e-a614-9c5f0bb8be8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:36.862576 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd35652c-b84a-451e-a614-9c5f0bb8be8d None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:36.862922 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd35652c-b84a-451e-a614-9c5f0bb8be8d None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:36.863196 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd35652c-b84a-451e-a614-9c5f0bb8be8d None admin] PATH_INFO: `/v3/projects` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:36.863999 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd35652c-b84a-451e-a614-9c5f0bb8be8d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 10:58:36.864307 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd35652c-b84a-451e-a614-9c5f0bb8be8d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:36.865752 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd35652c-b84a-451e-a614-9c5f0bb8be8d None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:36.870080 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527ff3a2-4798-4b4b-996d-769e92626c6d None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:36.872600 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:58:36.884391 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 328/664] 10.222.0.18 () {56 vars in 1148 bytes} [Thu Oct 13 10:58:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 10:58:36.886451 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd35652c-b84a-451e-a614-9c5f0bb8be8d None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:36.911039 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5e5b7c-9105-439a-b3d4-6b5e58f72073 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:36.911860 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5e5b7c-9105-439a-b3d4-6b5e58f72073 None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:36.912277 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5e5b7c-9105-439a-b3d4-6b5e58f72073 None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:36.912645 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5e5b7c-9105-439a-b3d4-6b5e58f72073 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:36.914030 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5e5b7c-9105-439a-b3d4-6b5e58f72073 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:36.915726 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5e5b7c-9105-439a-b3d4-6b5e58f72073 None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:36.930856 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application [None req-3d5e5b7c-9105-439a-b3d4-6b5e58f72073 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 13 10:58:36.930856 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 10:58:36.930856 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 13 10:58:36.930856 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 13 10:58:36.930856 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 13 10:58:36.930856 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 13 10:58:36.930856 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 13 10:58:36.930856 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 13 10:58:36.930856 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 13 10:58:36.930856 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application Oct 13 10:58:36.930856 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 13 10:58:36.930856 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application Oct 13 10:58:36.930856 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 10:58:36.930856 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 10:58:36.930856 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 10:58:36.930856 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 10:58:36.931948 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 10:58:36.931948 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 10:58:36.931948 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 10:58:36.931948 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 10:58:36.931948 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 10:58:36.931948 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 10:58:36.931948 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 10:58:36.931948 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 13 10:58:36.931948 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 13 10:58:36.931948 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 13 10:58:36.931948 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 13 10:58:36.931948 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 10:58:36.931948 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 10:58:36.931948 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 10:58:36.931948 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 10:58:36.931948 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 10:58:36.931948 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 10:58:36.932955 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 10:58:36.932955 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application with Lock( Oct 13 10:58:36.932955 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 10:58:36.932955 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._enter() Oct 13 10:58:36.932955 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 10:58:36.932955 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 10:58:36.932955 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 10:58:36.932955 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.creator() Oct 13 10:58:36.932955 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 10:58:36.932955 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application created_value = creator( Oct 13 10:58:36.932955 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 13 10:58:36.932955 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 13 10:58:36.932955 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 13 10:58:36.932955 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application Oct 13 10:58:36.932955 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 337/665] 10.222.0.18 () {56 vars in 1132 bytes} [Thu Oct 13 10:58:36 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 13 10:58:36.938492 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5e5b7c-9105-439a-b3d4-6b5e58f72073 None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:36.983295 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:58:37.015014 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd35652c-b84a-451e-a614-9c5f0bb8be8d None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:37.050205 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9a9174-3f85-4622-a129-4a9c57de7790 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:37.050857 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9a9174-3f85-4622-a129-4a9c57de7790 None admin] REQUEST_METHOD: `PUT` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:37.051133 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9a9174-3f85-4622-a129-4a9c57de7790 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:37.051403 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9a9174-3f85-4622-a129-4a9c57de7790 None admin] PATH_INFO: `/v3/projects/112613528384453abe7506465609fbd8/users/ed56f3fe2ddc48ee9882712aadaa2001/roles/e6e5c2b89fa04f0ca6cb23159febaa30` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:37.053625 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9a9174-3f85-4622-a129-4a9c57de7790 None admin] RBAC: Authorizing `identity:create_grant(project_id=112613528384453abe7506465609fbd8, user_id=ed56f3fe2ddc48ee9882712aadaa2001, role_id=e6e5c2b89fa04f0ca6cb23159febaa30)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:37.055750 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9a9174-3f85-4622-a129-4a9c57de7790 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:37.056313 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5e5b7c-9105-439a-b3d4-6b5e58f72073 None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:37.077036 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 329/666] 10.222.0.18 () {58 vars in 1439 bytes} [Thu Oct 13 10:58:36 2022] PUT /identity/v3/projects/112613528384453abe7506465609fbd8/users/ed56f3fe2ddc48ee9882712aadaa2001/roles/e6e5c2b89fa04f0ca6cb23159febaa30 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 10:58:37.077036 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb9f226-7823-47bd-9891-a2b77465bf9d None None] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:37.077036 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb9f226-7823-47bd-9891-a2b77465bf9d None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:37.077036 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb9f226-7823-47bd-9891-a2b77465bf9d None None] PATH_INFO: `/` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:37.077036 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 330/667] 10.222.0.18 () {54 vars in 927 bytes} [Thu Oct 13 10:58:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 10:58:37.080182 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61fb012-27ee-4c87-845d-2de0a851732e None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:37.080466 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61fb012-27ee-4c87-845d-2de0a851732e None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:37.080739 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61fb012-27ee-4c87-845d-2de0a851732e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:37.098551 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f2c128-0ac4-4900-ab7a-970985fe649e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:37.099230 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f2c128-0ac4-4900-ab7a-970985fe649e None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:37.099454 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f2c128-0ac4-4900-ab7a-970985fe649e None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:37.099728 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f2c128-0ac4-4900-ab7a-970985fe649e None admin] PATH_INFO: `/v3/services` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:37.100215 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-a61fb012-27ee-4c87-845d-2de0a851732e None None] MFA Rules not processed for user `8ba31ade43694cf8bf28f7528a9ea179`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 10:58:37.100390 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f2c128-0ac4-4900-ab7a-970985fe649e None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81533) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 10:58:37.101231 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f2c128-0ac4-4900-ab7a-970985fe649e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:37.102239 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-a61fb012-27ee-4c87-845d-2de0a851732e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 10:58:37.102705 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f2c128-0ac4-4900-ab7a-970985fe649e None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:37.112971 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 338/668] 10.222.0.18 () {56 vars in 1126 bytes} [Thu Oct 13 10:58:36 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 10:58:37.113994 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f2c128-0ac4-4900-ab7a-970985fe649e None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:37.153355 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:58:37.210250 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 331/669] 10.222.0.18 () {58 vars in 1024 bytes} [Thu Oct 13 10:58:37 2022] POST /identity/v3/auth/tokens => generated 1373 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 13 10:58:37.246278 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f2c128-0ac4-4900-ab7a-970985fe649e None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:37.289082 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec12eedc-6915-4c53-8b64-c0ad266d6553 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:37.289699 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec12eedc-6915-4c53-8b64-c0ad266d6553 None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:37.289977 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec12eedc-6915-4c53-8b64-c0ad266d6553 None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:37.290248 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec12eedc-6915-4c53-8b64-c0ad266d6553 None admin] PATH_INFO: `/v3/services` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:37.290877 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec12eedc-6915-4c53-8b64-c0ad266d6553 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81533) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 10:58:37.291179 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec12eedc-6915-4c53-8b64-c0ad266d6553 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:37.292559 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec12eedc-6915-4c53-8b64-c0ad266d6553 None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:37.298186 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 339/670] 10.222.0.18 () {56 vars in 1126 bytes} [Thu Oct 13 10:58:37 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 10:58:37.303797 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61fb012-27ee-4c87-845d-2de0a851732e None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:37.372809 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:58:37.412157 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61fb012-27ee-4c87-845d-2de0a851732e None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:37.449255 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d721d62-5579-405c-ac08-33f8278f76a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:37.449980 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d721d62-5579-405c-ac08-33f8278f76a2 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:37.450312 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d721d62-5579-405c-ac08-33f8278f76a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:37.450592 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d721d62-5579-405c-ac08-33f8278f76a2 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:37.451488 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d721d62-5579-405c-ac08-33f8278f76a2 None admin] RBAC: Adding query filter params (interface=public, service_id=e39fab05413749c8ad16ee3906af4649, region_id=RegionOne) {{(pid=81534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 10:58:37.451797 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d721d62-5579-405c-ac08-33f8278f76a2 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:37.453186 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d721d62-5579-405c-ac08-33f8278f76a2 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:37.458753 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 332/671] 10.222.0.18 () {56 vars in 1251 bytes} [Thu Oct 13 10:58:37 2022] GET /identity/v3/endpoints?service_id=e39fab05413749c8ad16ee3906af4649&interface=public®ion_id=RegionOne => generated 194 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 10:58:37.466183 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec12eedc-6915-4c53-8b64-c0ad266d6553 None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:37.531513 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d721d62-5579-405c-ac08-33f8278f76a2 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:37.576785 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:58:37.585835 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec12eedc-6915-4c53-8b64-c0ad266d6553 None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:37.631157 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454ac70f-a325-43d3-8d3f-762eb1c6f74f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:37.633163 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454ac70f-a325-43d3-8d3f-762eb1c6f74f None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:37.633926 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454ac70f-a325-43d3-8d3f-762eb1c6f74f None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:37.634405 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454ac70f-a325-43d3-8d3f-762eb1c6f74f None admin] PATH_INFO: `/v3/services` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:37.635476 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454ac70f-a325-43d3-8d3f-762eb1c6f74f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:37.637482 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454ac70f-a325-43d3-8d3f-762eb1c6f74f None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:37.646333 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 340/672] 10.222.0.18 () {56 vars in 1087 bytes} [Thu Oct 13 10:58:37 2022] GET /identity/v3/services => generated 1258 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 13 10:58:37.656756 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d721d62-5579-405c-ac08-33f8278f76a2 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:37.694264 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:58:37.701613 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c59ff9-78e6-4030-a05b-698fa008800d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:37.702320 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c59ff9-78e6-4030-a05b-698fa008800d None admin] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:37.702671 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c59ff9-78e6-4030-a05b-698fa008800d None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:37.703012 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c59ff9-78e6-4030-a05b-698fa008800d None admin] PATH_INFO: `/v3/services` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:37.703748 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c59ff9-78e6-4030-a05b-698fa008800d None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:37.705227 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c59ff9-78e6-4030-a05b-698fa008800d None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:37.725638 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 333/673] 10.222.0.18 () {60 vars in 1141 bytes} [Thu Oct 13 10:58:37 2022] POST /identity/v3/services => generated 251 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 13 10:58:38.090832 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c8891e-fc36-4210-aa64-5da9cc7fb015 None None] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:38.091221 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c8891e-fc36-4210-aa64-5da9cc7fb015 None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:38.091399 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c8891e-fc36-4210-aa64-5da9cc7fb015 None None] PATH_INFO: `/` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:38.092974 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 341/674] 10.222.0.18 () {54 vars in 927 bytes} [Thu Oct 13 10:58:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 10:58:38.098493 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9507d4-e49c-4cec-b5ed-be9b0da61e7d None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:38.098776 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9507d4-e49c-4cec-b5ed-be9b0da61e7d None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:38.099048 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9507d4-e49c-4cec-b5ed-be9b0da61e7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:38.118054 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-9c9507d4-e49c-4cec-b5ed-be9b0da61e7d None None] MFA Rules not processed for user `8ba31ade43694cf8bf28f7528a9ea179`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 10:58:38.119237 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-9c9507d4-e49c-4cec-b5ed-be9b0da61e7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 10:58:38.193241 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 334/675] 10.222.0.18 () {58 vars in 1024 bytes} [Thu Oct 13 10:58:38 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 13 10:58:38.468496 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c8891e-fc36-4210-aa64-5da9cc7fb015 None None] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:38.570699 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c8891e-fc36-4210-aa64-5da9cc7fb015 None None] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:38.612499 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0357e30e-6dfe-4859-9dd4-be79621eb6e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:38.613154 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0357e30e-6dfe-4859-9dd4-be79621eb6e0 None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:38.613435 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0357e30e-6dfe-4859-9dd4-be79621eb6e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:38.613707 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0357e30e-6dfe-4859-9dd4-be79621eb6e0 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:38.614291 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0357e30e-6dfe-4859-9dd4-be79621eb6e0 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:38.615654 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0357e30e-6dfe-4859-9dd4-be79621eb6e0 None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:38.624865 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application [None req-0357e30e-6dfe-4859-9dd4-be79621eb6e0 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 13 10:58:38.624865 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 10:58:38.624865 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 13 10:58:38.624865 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 13 10:58:38.624865 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 13 10:58:38.624865 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 13 10:58:38.624865 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 13 10:58:38.624865 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 13 10:58:38.624865 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 13 10:58:38.624865 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application Oct 13 10:58:38.624865 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 13 10:58:38.624865 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application Oct 13 10:58:38.624865 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 10:58:38.624865 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 10:58:38.624865 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 10:58:38.624865 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 10:58:38.624865 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 10:58:38.625920 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 10:58:38.625920 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 10:58:38.625920 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 10:58:38.625920 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 10:58:38.625920 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 10:58:38.625920 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 10:58:38.625920 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 13 10:58:38.625920 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 13 10:58:38.625920 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 13 10:58:38.625920 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 13 10:58:38.625920 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 10:58:38.625920 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 10:58:38.625920 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 10:58:38.625920 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 10:58:38.625920 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 10:58:38.625920 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 10:58:38.626797 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 10:58:38.626797 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application with Lock( Oct 13 10:58:38.626797 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 10:58:38.626797 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._enter() Oct 13 10:58:38.626797 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 10:58:38.626797 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 10:58:38.626797 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 10:58:38.626797 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.creator() Oct 13 10:58:38.626797 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 10:58:38.626797 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application created_value = creator( Oct 13 10:58:38.626797 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 13 10:58:38.626797 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 13 10:58:38.626797 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 13 10:58:38.626797 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application Oct 13 10:58:38.626797 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 342/676] 10.222.0.18 () {56 vars in 1126 bytes} [Thu Oct 13 10:58:38 2022] GET /identity/v3/services/object-store => generated 93 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 10:58:38.633551 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9507d4-e49c-4cec-b5ed-be9b0da61e7d None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:38.735760 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9507d4-e49c-4cec-b5ed-be9b0da61e7d None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:38.758301 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:58:38.774173 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8865b5-9fe0-4090-9d5d-37682acc1dc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:38.774780 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8865b5-9fe0-4090-9d5d-37682acc1dc4 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:38.775060 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8865b5-9fe0-4090-9d5d-37682acc1dc4 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:38.775335 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8865b5-9fe0-4090-9d5d-37682acc1dc4 None admin] PATH_INFO: `/v3/services` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:38.775974 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8865b5-9fe0-4090-9d5d-37682acc1dc4 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 10:58:38.776277 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8865b5-9fe0-4090-9d5d-37682acc1dc4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:38.777700 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8865b5-9fe0-4090-9d5d-37682acc1dc4 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:38.782815 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 335/677] 10.222.0.18 () {56 vars in 1122 bytes} [Thu Oct 13 10:58:38 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 10:58:38.794066 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0357e30e-6dfe-4859-9dd4-be79621eb6e0 None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:38.820993 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:58:38.901985 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0357e30e-6dfe-4859-9dd4-be79621eb6e0 None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:38.938197 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1022f78-3dd2-4776-9fb2-6ddd05e1efe9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:38.938810 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1022f78-3dd2-4776-9fb2-6ddd05e1efe9 None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:38.939087 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1022f78-3dd2-4776-9fb2-6ddd05e1efe9 None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:38.939361 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1022f78-3dd2-4776-9fb2-6ddd05e1efe9 None admin] PATH_INFO: `/v3/services` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:38.939994 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1022f78-3dd2-4776-9fb2-6ddd05e1efe9 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81533) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 10:58:38.940294 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1022f78-3dd2-4776-9fb2-6ddd05e1efe9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:38.941808 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1022f78-3dd2-4776-9fb2-6ddd05e1efe9 None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:38.947772 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 343/678] 10.222.0.18 () {56 vars in 1122 bytes} [Thu Oct 13 10:58:38 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 10:58:38.953692 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8865b5-9fe0-4090-9d5d-37682acc1dc4 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:39.066219 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8865b5-9fe0-4090-9d5d-37682acc1dc4 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:39.101722 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f63d00-db0f-4fa4-a728-d61e428eb101 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:39.102326 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f63d00-db0f-4fa4-a728-d61e428eb101 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:39.102606 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f63d00-db0f-4fa4-a728-d61e428eb101 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:39.102879 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f63d00-db0f-4fa4-a728-d61e428eb101 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:39.103581 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f63d00-db0f-4fa4-a728-d61e428eb101 None admin] RBAC: Adding query filter params (interface=public, service_id=1255fa7b96b845818e6fa3ae819fe995, region_id=RegionOne) {{(pid=81534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 10:58:39.103889 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f63d00-db0f-4fa4-a728-d61e428eb101 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:39.105298 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f63d00-db0f-4fa4-a728-d61e428eb101 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:39.110797 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 336/679] 10.222.0.18 () {56 vars in 1251 bytes} [Thu Oct 13 10:58:38 2022] GET /identity/v3/endpoints?service_id=1255fa7b96b845818e6fa3ae819fe995&interface=public®ion_id=RegionOne => generated 194 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 10:58:39.118110 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1022f78-3dd2-4776-9fb2-6ddd05e1efe9 None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:39.214151 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:58:39.228108 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1022f78-3dd2-4776-9fb2-6ddd05e1efe9 None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:39.263927 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35af686-c1f3-495e-abdb-ff3b2306f1ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:39.264647 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35af686-c1f3-495e-abdb-ff3b2306f1ba None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:39.264930 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35af686-c1f3-495e-abdb-ff3b2306f1ba None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:39.265246 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35af686-c1f3-495e-abdb-ff3b2306f1ba None admin] PATH_INFO: `/v3/services` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:39.265859 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d35af686-c1f3-495e-abdb-ff3b2306f1ba None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:39.267220 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d35af686-c1f3-495e-abdb-ff3b2306f1ba None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:39.273597 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 344/680] 10.222.0.18 () {56 vars in 1087 bytes} [Thu Oct 13 10:58:39 2022] GET /identity/v3/services => generated 1497 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 13 10:58:39.419969 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f75e433-1b55-430c-bdca-9aa0b0f316ed None None] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:39.420335 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f75e433-1b55-430c-bdca-9aa0b0f316ed None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:39.420710 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f75e433-1b55-430c-bdca-9aa0b0f316ed None None] PATH_INFO: `/` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:39.422234 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 337/681] 10.222.0.18 () {54 vars in 927 bytes} [Thu Oct 13 10:58:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 10:58:39.434573 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8842ce46-15f1-4336-a865-ea10274b5c31 None None] REQUEST_METHOD: `POST` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:39.434573 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8842ce46-15f1-4336-a865-ea10274b5c31 None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:39.434573 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8842ce46-15f1-4336-a865-ea10274b5c31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:39.452290 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.auth.core [None req-8842ce46-15f1-4336-a865-ea10274b5c31 None None] MFA Rules not processed for user `8ba31ade43694cf8bf28f7528a9ea179`. Rule list: `[]` (Enabled: `True`). {{(pid=81533) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 10:58:39.453809 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-8842ce46-15f1-4336-a865-ea10274b5c31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 10:58:39.529753 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 345/682] 10.222.0.18 () {58 vars in 1024 bytes} [Thu Oct 13 10:58:39 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 13 10:58:39.806870 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f75e433-1b55-430c-bdca-9aa0b0f316ed None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:39.861773 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:58:39.921220 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f75e433-1b55-430c-bdca-9aa0b0f316ed None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:39.943209 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72be1f5f-38ee-49a4-9ff1-b43ef1bf866f None None] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:39.943543 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72be1f5f-38ee-49a4-9ff1-b43ef1bf866f None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:39.943979 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72be1f5f-38ee-49a4-9ff1-b43ef1bf866f None None] PATH_INFO: `/` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:39.946131 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 346/683] 10.222.0.18 () {54 vars in 927 bytes} [Thu Oct 13 10:58:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 10:58:39.952974 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34449fc5-1cb6-47e5-b49f-1c992d720ffa None None] REQUEST_METHOD: `POST` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:39.953635 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34449fc5-1cb6-47e5-b49f-1c992d720ffa None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:39.954112 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34449fc5-1cb6-47e5-b49f-1c992d720ffa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:39.963567 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6e607c-ce84-4ddf-8574-dfd64f541189 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:39.964229 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6e607c-ce84-4ddf-8574-dfd64f541189 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:39.964511 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6e607c-ce84-4ddf-8574-dfd64f541189 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:39.964782 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6e607c-ce84-4ddf-8574-dfd64f541189 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:39.978405 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.auth.core [None req-34449fc5-1cb6-47e5-b49f-1c992d720ffa None None] MFA Rules not processed for user `8ba31ade43694cf8bf28f7528a9ea179`. Rule list: `[]` (Enabled: `True`). {{(pid=81533) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 10:58:39.979936 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-34449fc5-1cb6-47e5-b49f-1c992d720ffa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 10:58:39.980498 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6e607c-ce84-4ddf-8574-dfd64f541189 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 13 10:58:39.986648 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application [None req-4e6e607c-ce84-4ddf-8574-dfd64f541189 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 13 10:58:39.986648 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 10:58:39.986648 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 10:58:39.986648 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 10:58:39.986648 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 10:58:39.986648 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 10:58:39.986648 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 10:58:39.986648 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 10:58:39.986648 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 10:58:39.986648 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 10:58:39.986648 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 10:58:39.986648 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 10:58:39.986648 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 13 10:58:39.986648 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 13 10:58:39.986648 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 13 10:58:39.986648 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 13 10:58:39.987651 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 13 10:58:39.987651 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 13 10:58:39.987651 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 13 10:58:39.987651 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 13 10:58:39.987651 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 10:58:39.987651 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 10:58:39.987651 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 10:58:39.987651 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 10:58:39.987651 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 10:58:39.987651 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 10:58:39.987651 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 10:58:39.987651 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application with Lock( Oct 13 10:58:39.987651 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 10:58:39.987651 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._enter() Oct 13 10:58:39.987651 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 10:58:39.987651 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 10:58:39.988542 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 10:58:39.988542 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.creator() Oct 13 10:58:39.988542 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 10:58:39.988542 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application created_value = creator( Oct 13 10:58:39.988542 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 13 10:58:39.988542 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 13 10:58:39.988542 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 13 10:58:39.988542 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 13 10:58:39.988542 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 13 10:58:39.988542 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 13 10:58:39.988542 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 13 10:58:39.988542 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application Oct 13 10:58:39.988542 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 338/684] 10.222.0.18 () {56 vars in 1120 bytes} [Thu Oct 13 10:58:39 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 10:58:39.996658 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6e607c-ce84-4ddf-8574-dfd64f541189 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:40.073065 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 347/685] 10.222.0.18 () {58 vars in 1024 bytes} [Thu Oct 13 10:58:39 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 13 10:58:40.073065 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e7a975-f0b7-4b22-91a1-f598e4f17072 None None] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:40.073065 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e7a975-f0b7-4b22-91a1-f598e4f17072 None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:40.073065 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e7a975-f0b7-4b22-91a1-f598e4f17072 None None] PATH_INFO: `/` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:40.076377 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 348/686] 10.222.0.18 () {54 vars in 927 bytes} [Thu Oct 13 10:58:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 10:58:40.078826 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7421fe5-dcdc-49a3-88fa-fe4bf4f3903b None None] REQUEST_METHOD: `POST` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:40.079113 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7421fe5-dcdc-49a3-88fa-fe4bf4f3903b None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:40.079395 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7421fe5-dcdc-49a3-88fa-fe4bf4f3903b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:40.099452 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.auth.core [None req-e7421fe5-dcdc-49a3-88fa-fe4bf4f3903b None None] MFA Rules not processed for user `8ba31ade43694cf8bf28f7528a9ea179`. Rule list: `[]` (Enabled: `True`). {{(pid=81533) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 10:58:40.101329 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-e7421fe5-dcdc-49a3-88fa-fe4bf4f3903b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 10:58:40.112496 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:58:40.144631 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6e607c-ce84-4ddf-8574-dfd64f541189 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:40.149687 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:58:40.197715 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf16aeee-fee3-49c2-ae29-db0158e9f710 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:40.198736 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf16aeee-fee3-49c2-ae29-db0158e9f710 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:40.199211 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf16aeee-fee3-49c2-ae29-db0158e9f710 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:40.199690 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf16aeee-fee3-49c2-ae29-db0158e9f710 None admin] PATH_INFO: `/v3/roles` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:40.200545 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf16aeee-fee3-49c2-ae29-db0158e9f710 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 10:58:40.201067 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf16aeee-fee3-49c2-ae29-db0158e9f710 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:40.202626 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf16aeee-fee3-49c2-ae29-db0158e9f710 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:40.202748 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 349/687] 10.222.0.18 () {58 vars in 1024 bytes} [Thu Oct 13 10:58:40 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 13 10:58:40.213360 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 339/688] 10.222.0.18 () {56 vars in 1115 bytes} [Thu Oct 13 10:58:39 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 13 10:58:40.221196 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7421fe5-dcdc-49a3-88fa-fe4bf4f3903b None None] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:40.347831 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7421fe5-dcdc-49a3-88fa-fe4bf4f3903b None None] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:40.364812 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf16aeee-fee3-49c2-ae29-db0158e9f710 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:40.399082 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ee80f2-1ff3-4a0d-aeaa-54fecd50d2f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:40.400126 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ee80f2-1ff3-4a0d-aeaa-54fecd50d2f3 None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:40.400428 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ee80f2-1ff3-4a0d-aeaa-54fecd50d2f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:40.400701 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ee80f2-1ff3-4a0d-aeaa-54fecd50d2f3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:40.418180 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ee80f2-1ff3-4a0d-aeaa-54fecd50d2f3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:40.420872 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ee80f2-1ff3-4a0d-aeaa-54fecd50d2f3 None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:40.424580 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:58:40.447230 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application [None req-d0ee80f2-1ff3-4a0d-aeaa-54fecd50d2f3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 13 10:58:40.447230 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 10:58:40.447230 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 10:58:40.447230 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 10:58:40.447230 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 10:58:40.447230 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 10:58:40.447230 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 10:58:40.447230 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 10:58:40.447230 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 10:58:40.447230 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 10:58:40.447230 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 10:58:40.447230 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 10:58:40.447230 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 13 10:58:40.447230 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 13 10:58:40.447230 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 13 10:58:40.447230 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 13 10:58:40.448440 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 10:58:40.448440 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 10:58:40.448440 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 10:58:40.448440 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 10:58:40.448440 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 10:58:40.448440 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 10:58:40.448440 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 10:58:40.448440 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application with Lock( Oct 13 10:58:40.448440 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 10:58:40.448440 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._enter() Oct 13 10:58:40.448440 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 10:58:40.448440 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 10:58:40.448440 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 10:58:40.448440 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.creator() Oct 13 10:58:40.448440 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 10:58:40.448440 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application created_value = creator( Oct 13 10:58:40.448440 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 13 10:58:40.449738 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 13 10:58:40.449738 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 13 10:58:40.449738 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application Oct 13 10:58:40.452172 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 350/689] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Oct 13 10:58:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 10:58:40.457981 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ee80f2-1ff3-4a0d-aeaa-54fecd50d2f3 None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:40.500829 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf16aeee-fee3-49c2-ae29-db0158e9f710 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:40.547970 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f823769-bba1-4b3d-8a84-34449f251581 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:40.548605 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f823769-bba1-4b3d-8a84-34449f251581 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:40.548882 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f823769-bba1-4b3d-8a84-34449f251581 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:40.549184 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f823769-bba1-4b3d-8a84-34449f251581 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:40.550153 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f823769-bba1-4b3d-8a84-34449f251581 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:40.551904 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f823769-bba1-4b3d-8a84-34449f251581 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:40.565997 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application [None req-9f823769-bba1-4b3d-8a84-34449f251581 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 13 10:58:40.565997 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 10:58:40.565997 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 13 10:58:40.565997 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 13 10:58:40.565997 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 13 10:58:40.565997 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 13 10:58:40.565997 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 13 10:58:40.565997 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 13 10:58:40.565997 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 13 10:58:40.565997 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application Oct 13 10:58:40.565997 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 13 10:58:40.565997 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application Oct 13 10:58:40.565997 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 10:58:40.565997 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 10:58:40.565997 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 10:58:40.565997 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 10:58:40.567018 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 10:58:40.567018 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 10:58:40.567018 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 10:58:40.567018 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 10:58:40.567018 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 10:58:40.567018 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 10:58:40.567018 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 10:58:40.567018 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 13 10:58:40.567018 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 13 10:58:40.567018 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 13 10:58:40.567018 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 13 10:58:40.567018 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 10:58:40.567018 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 10:58:40.567018 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 10:58:40.567018 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 10:58:40.567018 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 10:58:40.567018 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 10:58:40.567960 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 10:58:40.567960 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application with Lock( Oct 13 10:58:40.567960 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 10:58:40.567960 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._enter() Oct 13 10:58:40.567960 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 10:58:40.567960 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 10:58:40.567960 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 10:58:40.567960 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.creator() Oct 13 10:58:40.567960 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 10:58:40.567960 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application created_value = creator( Oct 13 10:58:40.567960 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 13 10:58:40.567960 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 13 10:58:40.567960 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 13 10:58:40.567960 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application Oct 13 10:58:40.567960 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 340/690] 10.222.0.18 () {56 vars in 1132 bytes} [Thu Oct 13 10:58:40 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 13 10:58:40.569582 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f823769-bba1-4b3d-8a84-34449f251581 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:40.580705 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ee80f2-1ff3-4a0d-aeaa-54fecd50d2f3 None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:40.607917 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:58:40.625370 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e856560e-13c6-4aba-9174-576777019902 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:40.626374 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e856560e-13c6-4aba-9174-576777019902 None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:40.626782 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e856560e-13c6-4aba-9174-576777019902 None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:40.627044 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e856560e-13c6-4aba-9174-576777019902 None admin] PATH_INFO: `/v3/domains` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:40.627693 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e856560e-13c6-4aba-9174-576777019902 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81533) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 10:58:40.628002 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e856560e-13c6-4aba-9174-576777019902 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:40.630113 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e856560e-13c6-4aba-9174-576777019902 None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:40.647895 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 351/691] 10.222.0.18 () {56 vars in 1109 bytes} [Thu Oct 13 10:58:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 10:58:40.648937 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e856560e-13c6-4aba-9174-576777019902 None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:40.691493 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f823769-bba1-4b3d-8a84-34449f251581 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:40.713137 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:58:40.741021 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b8b1ca-000b-4549-8eda-8ebff450c7fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:40.741021 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b8b1ca-000b-4549-8eda-8ebff450c7fb None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:40.741021 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b8b1ca-000b-4549-8eda-8ebff450c7fb None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:40.741021 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b8b1ca-000b-4549-8eda-8ebff450c7fb None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:40.742305 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b8b1ca-000b-4549-8eda-8ebff450c7fb None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:40.742809 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b8b1ca-000b-4549-8eda-8ebff450c7fb None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:40.752690 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application [None req-48b8b1ca-000b-4549-8eda-8ebff450c7fb None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 13 10:58:40.752690 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 10:58:40.752690 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 13 10:58:40.752690 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 13 10:58:40.752690 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 13 10:58:40.752690 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 13 10:58:40.752690 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 13 10:58:40.752690 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 13 10:58:40.752690 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 13 10:58:40.752690 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application Oct 13 10:58:40.752690 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 13 10:58:40.752690 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application Oct 13 10:58:40.752690 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 10:58:40.752690 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 10:58:40.752690 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 10:58:40.752690 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 10:58:40.752690 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 10:58:40.754126 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 10:58:40.754126 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 10:58:40.754126 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 10:58:40.754126 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 10:58:40.754126 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 10:58:40.754126 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 10:58:40.754126 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 13 10:58:40.754126 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 13 10:58:40.754126 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 13 10:58:40.754126 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 13 10:58:40.754126 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 10:58:40.754126 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 10:58:40.754126 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 10:58:40.754126 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 10:58:40.754126 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 10:58:40.754126 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 10:58:40.755821 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 10:58:40.755821 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application with Lock( Oct 13 10:58:40.755821 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 10:58:40.755821 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._enter() Oct 13 10:58:40.755821 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 10:58:40.755821 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 10:58:40.755821 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 10:58:40.755821 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.creator() Oct 13 10:58:40.755821 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 10:58:40.755821 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application created_value = creator( Oct 13 10:58:40.755821 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 13 10:58:40.755821 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 13 10:58:40.755821 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 13 10:58:40.755821 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application Oct 13 10:58:40.755821 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 341/692] 10.222.0.18 () {56 vars in 1114 bytes} [Thu Oct 13 10:58:40 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 10:58:40.757397 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b8b1ca-000b-4549-8eda-8ebff450c7fb None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:40.781946 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e856560e-13c6-4aba-9174-576777019902 None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:40.829150 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7acc3fd-53fc-4204-9d7b-6b73b60b72d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:40.830178 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7acc3fd-53fc-4204-9d7b-6b73b60b72d2 None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:40.830459 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7acc3fd-53fc-4204-9d7b-6b73b60b72d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:40.830726 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7acc3fd-53fc-4204-9d7b-6b73b60b72d2 None admin] PATH_INFO: `/v3/services` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:40.831708 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7acc3fd-53fc-4204-9d7b-6b73b60b72d2 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81533) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 10:58:40.832199 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7acc3fd-53fc-4204-9d7b-6b73b60b72d2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:40.834556 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7acc3fd-53fc-4204-9d7b-6b73b60b72d2 None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:40.845052 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 352/693] 10.222.0.18 () {56 vars in 1126 bytes} [Thu Oct 13 10:58:40 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 10:58:40.845052 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7acc3fd-53fc-4204-9d7b-6b73b60b72d2 None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:40.866165 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:58:40.874256 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b8b1ca-000b-4549-8eda-8ebff450c7fb None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:40.910108 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15e6ae4-814a-4ee0-b06e-38365c1a18fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:40.910731 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15e6ae4-814a-4ee0-b06e-38365c1a18fa None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:40.911009 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15e6ae4-814a-4ee0-b06e-38365c1a18fa None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:40.911278 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15e6ae4-814a-4ee0-b06e-38365c1a18fa None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:40.920337 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e15e6ae4-814a-4ee0-b06e-38365c1a18fa None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:40.922918 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e15e6ae4-814a-4ee0-b06e-38365c1a18fa None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:40.936407 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application [None req-e15e6ae4-814a-4ee0-b06e-38365c1a18fa None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 13 10:58:40.936407 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 10:58:40.936407 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 10:58:40.936407 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 10:58:40.936407 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 10:58:40.936407 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 10:58:40.936407 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 10:58:40.936407 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 10:58:40.936407 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 10:58:40.936407 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 10:58:40.936407 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 10:58:40.936407 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 10:58:40.936407 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 13 10:58:40.936407 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 13 10:58:40.936407 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 13 10:58:40.936407 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 13 10:58:40.937460 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 10:58:40.937460 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 10:58:40.937460 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 13 10:58:40.937460 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 13 10:58:40.937460 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 13 10:58:40.937460 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 13 10:58:40.937460 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 10:58:40.937460 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 10:58:40.937460 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 10:58:40.937460 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 10:58:40.937460 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 10:58:40.937460 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application with Lock( Oct 13 10:58:40.937460 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 10:58:40.937460 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._enter() Oct 13 10:58:40.937460 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 10:58:40.937460 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 10:58:40.937460 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 10:58:40.937460 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.creator() Oct 13 10:58:40.943691 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 10:58:40.943691 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application created_value = creator( Oct 13 10:58:40.943691 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 13 10:58:40.943691 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 13 10:58:40.943691 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 13 10:58:40.943691 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 13 10:58:40.943691 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 13 10:58:40.943691 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 13 10:58:40.943691 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 13 10:58:40.943691 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application Oct 13 10:58:40.943691 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 342/694] 10.222.0.18 () {56 vars in 1117 bytes} [Thu Oct 13 10:58:40 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 10:58:40.943691 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15e6ae4-814a-4ee0-b06e-38365c1a18fa None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:40.971642 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7acc3fd-53fc-4204-9d7b-6b73b60b72d2 None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:40.991513 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:58:41.010276 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50699855-c6e8-46ff-beb3-c1385c3266d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:41.010904 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50699855-c6e8-46ff-beb3-c1385c3266d0 None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:41.011178 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50699855-c6e8-46ff-beb3-c1385c3266d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:41.011447 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50699855-c6e8-46ff-beb3-c1385c3266d0 None admin] PATH_INFO: `/v3/services` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:41.012066 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50699855-c6e8-46ff-beb3-c1385c3266d0 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81533) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 10:58:41.012378 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50699855-c6e8-46ff-beb3-c1385c3266d0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:41.013748 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50699855-c6e8-46ff-beb3-c1385c3266d0 None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:41.023747 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 353/695] 10.222.0.18 () {56 vars in 1114 bytes} [Thu Oct 13 10:58:40 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 10:58:41.024593 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50699855-c6e8-46ff-beb3-c1385c3266d0 None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:41.075290 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15e6ae4-814a-4ee0-b06e-38365c1a18fa None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:41.114652 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6193c3dd-8ad4-4397-84e6-26b7c210a7f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:41.115256 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6193c3dd-8ad4-4397-84e6-26b7c210a7f2 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:41.115535 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6193c3dd-8ad4-4397-84e6-26b7c210a7f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:41.115800 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6193c3dd-8ad4-4397-84e6-26b7c210a7f2 None admin] PATH_INFO: `/v3/services` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:41.117049 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6193c3dd-8ad4-4397-84e6-26b7c210a7f2 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 10:58:41.117538 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6193c3dd-8ad4-4397-84e6-26b7c210a7f2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:41.118926 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6193c3dd-8ad4-4397-84e6-26b7c210a7f2 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:41.124121 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 343/696] 10.222.0.18 () {56 vars in 1126 bytes} [Thu Oct 13 10:58:40 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 10:58:41.124867 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6193c3dd-8ad4-4397-84e6-26b7c210a7f2 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:41.132434 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50699855-c6e8-46ff-beb3-c1385c3266d0 None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:41.146239 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:58:41.167004 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c79083-8b05-4584-b78b-e76397e8a6d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:41.167602 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c79083-8b05-4584-b78b-e76397e8a6d7 None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:41.167878 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c79083-8b05-4584-b78b-e76397e8a6d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:41.168150 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c79083-8b05-4584-b78b-e76397e8a6d7 None admin] PATH_INFO: `/v3/users` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:41.168863 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c79083-8b05-4584-b78b-e76397e8a6d7 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81533) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 10:58:41.169186 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c79083-8b05-4584-b78b-e76397e8a6d7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:41.170593 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c79083-8b05-4584-b78b-e76397e8a6d7 None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:41.193042 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 354/697] 10.222.0.18 () {56 vars in 1149 bytes} [Thu Oct 13 10:58:41 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 10:58:41.193042 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c79083-8b05-4584-b78b-e76397e8a6d7 None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:41.232886 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:58:41.244629 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6193c3dd-8ad4-4397-84e6-26b7c210a7f2 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:41.281161 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b21c518-d7a5-43d6-8e53-f68557525c58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:41.281766 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b21c518-d7a5-43d6-8e53-f68557525c58 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:41.282041 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b21c518-d7a5-43d6-8e53-f68557525c58 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:41.282310 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b21c518-d7a5-43d6-8e53-f68557525c58 None admin] PATH_INFO: `/v3/services` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:41.282936 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b21c518-d7a5-43d6-8e53-f68557525c58 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 10:58:41.283238 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b21c518-d7a5-43d6-8e53-f68557525c58 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:41.284594 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b21c518-d7a5-43d6-8e53-f68557525c58 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:41.289924 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 344/698] 10.222.0.18 () {56 vars in 1114 bytes} [Thu Oct 13 10:58:41 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 10:58:41.290706 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b21c518-d7a5-43d6-8e53-f68557525c58 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:41.302141 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c79083-8b05-4584-b78b-e76397e8a6d7 None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:41.337489 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d71ce2-90da-4496-8fe6-05c329175ac0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:41.338097 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d71ce2-90da-4496-8fe6-05c329175ac0 None admin] REQUEST_METHOD: `POST` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:41.338373 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d71ce2-90da-4496-8fe6-05c329175ac0 None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:41.338640 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d71ce2-90da-4496-8fe6-05c329175ac0 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:41.339308 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d71ce2-90da-4496-8fe6-05c329175ac0 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:41.340671 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d71ce2-90da-4496-8fe6-05c329175ac0 None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:41.370912 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 355/699] 10.222.0.18 () {60 vars in 1144 bytes} [Thu Oct 13 10:58:41 2022] POST /identity/v3/endpoints => generated 347 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 13 10:58:41.371950 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d71ce2-90da-4496-8fe6-05c329175ac0 None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:41.380797 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:58:41.402874 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b21c518-d7a5-43d6-8e53-f68557525c58 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:41.455445 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c76b41-e3be-4e6a-b00c-7cc90a335894 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:41.456244 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c76b41-e3be-4e6a-b00c-7cc90a335894 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:41.456611 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c76b41-e3be-4e6a-b00c-7cc90a335894 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:41.456972 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c76b41-e3be-4e6a-b00c-7cc90a335894 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:41.499749 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:58:41.509079 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d71ce2-90da-4496-8fe6-05c329175ac0 None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:41.549585 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c76b41-e3be-4e6a-b00c-7cc90a335894 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:41.550685 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3ef941-bbae-4e87-9d5c-8cb6e204c2e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:41.551464 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3ef941-bbae-4e87-9d5c-8cb6e204c2e1 None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:41.551747 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3ef941-bbae-4e87-9d5c-8cb6e204c2e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:41.552019 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3ef941-bbae-4e87-9d5c-8cb6e204c2e1 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:41.552565 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c76b41-e3be-4e6a-b00c-7cc90a335894 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:41.552737 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3ef941-bbae-4e87-9d5c-8cb6e204c2e1 None admin] RBAC: Adding query filter params (interface=public, service_id=6b78728516b249cd8fdbbbb00eac3f11, region_id=RegionOne) {{(pid=81533) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 10:58:41.553055 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3ef941-bbae-4e87-9d5c-8cb6e204c2e1 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:41.554687 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3ef941-bbae-4e87-9d5c-8cb6e204c2e1 None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:41.560779 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 356/700] 10.222.0.18 () {56 vars in 1251 bytes} [Thu Oct 13 10:58:41 2022] GET /identity/v3/endpoints?service_id=6b78728516b249cd8fdbbbb00eac3f11&interface=public®ion_id=RegionOne => generated 194 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 10:58:41.567106 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3ef941-bbae-4e87-9d5c-8cb6e204c2e1 None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:41.653219 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:58:41.677047 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 345/701] 10.222.0.18 () {58 vars in 1282 bytes} [Thu Oct 13 10:58:41 2022] GET /identity/v3/auth/tokens => generated 1474 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 13 10:58:41.678473 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fccd747-e2e3-4c46-90dc-9bc6eeb5a558 None None] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:41.678854 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fccd747-e2e3-4c46-90dc-9bc6eeb5a558 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:41.679199 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fccd747-e2e3-4c46-90dc-9bc6eeb5a558 None None] PATH_INFO: `/` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:41.680664 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 346/702] 10.222.0.18 () {54 vars in 927 bytes} [Thu Oct 13 10:58:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 10:58:41.683889 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fccd747-e2e3-4c46-90dc-9bc6eeb5a558 None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:41.691330 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3ef941-bbae-4e87-9d5c-8cb6e204c2e1 None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:41.729806 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8e546b-48e3-4211-9761-48cb0defd684 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:41.730426 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8e546b-48e3-4211-9761-48cb0defd684 None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:41.730706 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8e546b-48e3-4211-9761-48cb0defd684 None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:41.730980 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8e546b-48e3-4211-9761-48cb0defd684 None admin] PATH_INFO: `/v3/services` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:41.731590 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8e546b-48e3-4211-9761-48cb0defd684 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:41.732963 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8e546b-48e3-4211-9761-48cb0defd684 None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:41.747428 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 357/703] 10.222.0.18 () {56 vars in 1087 bytes} [Thu Oct 13 10:58:41 2022] GET /identity/v3/services => generated 1497 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 13 10:58:41.747428 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36197f26-fcb0-4e17-bd0e-096269a6581b None None] REQUEST_METHOD: `POST` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:41.747428 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36197f26-fcb0-4e17-bd0e-096269a6581b None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:41.747428 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36197f26-fcb0-4e17-bd0e-096269a6581b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:41.762019 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.auth.core [None req-36197f26-fcb0-4e17-bd0e-096269a6581b None None] MFA Rules not processed for user `8ba31ade43694cf8bf28f7528a9ea179`. Rule list: `[]` (Enabled: `True`). {{(pid=81533) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 10:58:41.763367 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-36197f26-fcb0-4e17-bd0e-096269a6581b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 10:58:41.784676 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:58:41.807332 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fccd747-e2e3-4c46-90dc-9bc6eeb5a558 None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:41.849861 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 358/704] 10.222.0.18 () {58 vars in 1024 bytes} [Thu Oct 13 10:58:41 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 13 10:58:41.850241 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d02d690-d64c-4965-935c-ad361fa784d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:41.850891 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d02d690-d64c-4965-935c-ad361fa784d7 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:41.851321 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d02d690-d64c-4965-935c-ad361fa784d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:41.851474 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d02d690-d64c-4965-935c-ad361fa784d7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:41.870799 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d02d690-d64c-4965-935c-ad361fa784d7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:41.872266 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d02d690-d64c-4965-935c-ad361fa784d7 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:41.889297 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application [None req-3d02d690-d64c-4965-935c-ad361fa784d7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 13 10:58:41.889297 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 10:58:41.889297 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 10:58:41.889297 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 10:58:41.889297 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 10:58:41.889297 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 10:58:41.889297 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 10:58:41.889297 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 10:58:41.889297 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 10:58:41.889297 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 10:58:41.889297 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 10:58:41.889297 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 10:58:41.889297 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 13 10:58:41.889297 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 13 10:58:41.889297 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 13 10:58:41.889297 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 13 10:58:41.890334 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 10:58:41.890334 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 10:58:41.890334 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 10:58:41.890334 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 10:58:41.890334 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 10:58:41.890334 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 10:58:41.890334 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 10:58:41.890334 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application with Lock( Oct 13 10:58:41.890334 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 10:58:41.890334 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._enter() Oct 13 10:58:41.890334 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 10:58:41.890334 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 10:58:41.890334 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 10:58:41.890334 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.creator() Oct 13 10:58:41.890334 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 10:58:41.890334 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application created_value = creator( Oct 13 10:58:41.890334 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 13 10:58:41.891467 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 13 10:58:41.891467 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 13 10:58:41.891467 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application Oct 13 10:58:41.891467 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 347/705] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Oct 13 10:58:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 10:58:41.898435 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36197f26-fcb0-4e17-bd0e-096269a6581b None None] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:42.010102 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36197f26-fcb0-4e17-bd0e-096269a6581b None None] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:42.046570 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6543bd6-40f2-4dab-b3fb-6f529e21ec5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:42.047470 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6543bd6-40f2-4dab-b3fb-6f529e21ec5f None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:42.047957 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6543bd6-40f2-4dab-b3fb-6f529e21ec5f None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:42.048399 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6543bd6-40f2-4dab-b3fb-6f529e21ec5f None admin] PATH_INFO: `/v3/domains` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:42.049235 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6543bd6-40f2-4dab-b3fb-6f529e21ec5f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81533) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 10:58:42.049708 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6543bd6-40f2-4dab-b3fb-6f529e21ec5f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:42.051290 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6543bd6-40f2-4dab-b3fb-6f529e21ec5f None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:42.068514 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 359/706] 10.222.0.18 () {56 vars in 1109 bytes} [Thu Oct 13 10:58:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 10:58:42.070601 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d02d690-d64c-4965-935c-ad361fa784d7 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:42.103548 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:58:42.141569 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6543bd6-40f2-4dab-b3fb-6f529e21ec5f None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:42.164490 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:58:42.189175 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d02d690-d64c-4965-935c-ad361fa784d7 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:42.224297 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1b49b6-303c-4262-88cb-f739ea08bf1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:42.224927 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1b49b6-303c-4262-88cb-f739ea08bf1c None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:42.225231 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1b49b6-303c-4262-88cb-f739ea08bf1c None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:42.226055 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1b49b6-303c-4262-88cb-f739ea08bf1c None admin] PATH_INFO: `/v3/projects/service` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:42.233462 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1b49b6-303c-4262-88cb-f739ea08bf1c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:42.234903 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1b49b6-303c-4262-88cb-f739ea08bf1c None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:42.246716 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application [None req-5b1b49b6-303c-4262-88cb-f739ea08bf1c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 13 10:58:42.246716 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 10:58:42.246716 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 10:58:42.246716 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 10:58:42.246716 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 10:58:42.246716 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 10:58:42.246716 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 10:58:42.246716 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 10:58:42.246716 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 10:58:42.246716 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 10:58:42.246716 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 10:58:42.246716 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 10:58:42.246716 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 13 10:58:42.246716 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 13 10:58:42.246716 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 13 10:58:42.247636 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 13 10:58:42.247636 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 10:58:42.247636 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 10:58:42.247636 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 10:58:42.247636 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 10:58:42.247636 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 10:58:42.247636 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 10:58:42.247636 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 10:58:42.247636 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application with Lock( Oct 13 10:58:42.247636 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 10:58:42.247636 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._enter() Oct 13 10:58:42.247636 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 10:58:42.247636 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 10:58:42.247636 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 10:58:42.247636 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.creator() Oct 13 10:58:42.247636 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 10:58:42.247636 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application created_value = creator( Oct 13 10:58:42.248559 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 13 10:58:42.248559 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 13 10:58:42.248559 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 13 10:58:42.248559 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 13 10:58:42.248559 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 13 10:58:42.248559 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 13 10:58:42.248559 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 13 10:58:42.248559 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application Oct 13 10:58:42.248559 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 348/707] 10.222.0.18 () {56 vars in 1111 bytes} [Thu Oct 13 10:58:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 13 10:58:42.257801 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1b49b6-303c-4262-88cb-f739ea08bf1c None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:42.286052 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6543bd6-40f2-4dab-b3fb-6f529e21ec5f None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:42.322736 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b447bb-562c-4fce-9ae7-62a0c239c467 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:42.323490 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b447bb-562c-4fce-9ae7-62a0c239c467 None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:42.323839 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b447bb-562c-4fce-9ae7-62a0c239c467 None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:42.324178 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b447bb-562c-4fce-9ae7-62a0c239c467 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:42.324854 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b447bb-562c-4fce-9ae7-62a0c239c467 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:42.326395 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b447bb-562c-4fce-9ae7-62a0c239c467 None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:42.336295 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application [None req-c7b447bb-562c-4fce-9ae7-62a0c239c467 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 13 10:58:42.336295 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 10:58:42.336295 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 13 10:58:42.336295 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 13 10:58:42.336295 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 13 10:58:42.336295 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 13 10:58:42.336295 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 13 10:58:42.336295 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 13 10:58:42.336295 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 13 10:58:42.336295 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application Oct 13 10:58:42.336295 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 13 10:58:42.336295 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application Oct 13 10:58:42.336295 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 10:58:42.336295 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 10:58:42.336295 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 10:58:42.336295 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 10:58:42.336295 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 10:58:42.338561 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 10:58:42.338561 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 10:58:42.338561 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 10:58:42.338561 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 10:58:42.338561 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 10:58:42.338561 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 10:58:42.338561 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 13 10:58:42.338561 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 13 10:58:42.338561 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 13 10:58:42.338561 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 13 10:58:42.338561 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 10:58:42.338561 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 10:58:42.338561 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 10:58:42.338561 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 10:58:42.338561 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 10:58:42.338561 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 10:58:42.340067 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 10:58:42.340067 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application with Lock( Oct 13 10:58:42.340067 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 10:58:42.340067 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._enter() Oct 13 10:58:42.340067 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 10:58:42.340067 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 10:58:42.340067 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 10:58:42.340067 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.creator() Oct 13 10:58:42.340067 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 10:58:42.340067 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application created_value = creator( Oct 13 10:58:42.340067 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 13 10:58:42.340067 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 13 10:58:42.340067 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 13 10:58:42.340067 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application Oct 13 10:58:42.340067 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 360/708] 10.222.0.18 () {56 vars in 1126 bytes} [Thu Oct 13 10:58:42 2022] GET /identity/v3/services/object-store => generated 93 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 13 10:58:42.346292 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b447bb-562c-4fce-9ae7-62a0c239c467 None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:42.373801 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:58:42.388963 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1b49b6-303c-4262-88cb-f739ea08bf1c None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:42.426853 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8ba536-abcc-4bb3-8516-ca507e21c6c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:42.427508 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8ba536-abcc-4bb3-8516-ca507e21c6c7 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:42.427786 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8ba536-abcc-4bb3-8516-ca507e21c6c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:42.428058 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8ba536-abcc-4bb3-8516-ca507e21c6c7 None admin] PATH_INFO: `/v3/projects` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:42.428798 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8ba536-abcc-4bb3-8516-ca507e21c6c7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 10:58:42.429139 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8ba536-abcc-4bb3-8516-ca507e21c6c7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:42.430584 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8ba536-abcc-4bb3-8516-ca507e21c6c7 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:42.441263 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:58:42.446751 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 349/709] 10.222.0.18 () {56 vars in 1148 bytes} [Thu Oct 13 10:58:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 10:58:42.453448 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8ba536-abcc-4bb3-8516-ca507e21c6c7 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:42.473713 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b447bb-562c-4fce-9ae7-62a0c239c467 None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:42.517150 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8659d81-de19-4457-999e-331048fb8262 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:42.517761 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8659d81-de19-4457-999e-331048fb8262 None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:42.518199 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8659d81-de19-4457-999e-331048fb8262 None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:42.518477 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8659d81-de19-4457-999e-331048fb8262 None admin] PATH_INFO: `/v3/services` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:42.519426 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8659d81-de19-4457-999e-331048fb8262 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81533) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 10:58:42.519733 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8659d81-de19-4457-999e-331048fb8262 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:42.521625 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8659d81-de19-4457-999e-331048fb8262 None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:42.528570 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 361/710] 10.222.0.18 () {56 vars in 1122 bytes} [Thu Oct 13 10:58:42 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 10:58:42.534085 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8659d81-de19-4457-999e-331048fb8262 None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:42.570498 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8ba536-abcc-4bb3-8516-ca507e21c6c7 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:42.608477 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee70173-a0e8-4cd0-b0f6-22649fc3847f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:42.609106 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee70173-a0e8-4cd0-b0f6-22649fc3847f None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:42.609386 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee70173-a0e8-4cd0-b0f6-22649fc3847f None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:42.609655 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee70173-a0e8-4cd0-b0f6-22649fc3847f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:42.610441 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee70173-a0e8-4cd0-b0f6-22649fc3847f None admin] RBAC: Adding query filter params (role.id=e6e5c2b89fa04f0ca6cb23159febaa30, scope.project.id=112613528384453abe7506465609fbd8, user.id=ed56f3fe2ddc48ee9882712aadaa2001) {{(pid=81534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 10:58:42.610667 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee70173-a0e8-4cd0-b0f6-22649fc3847f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:42.612196 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee70173-a0e8-4cd0-b0f6-22649fc3847f None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:42.625571 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 350/711] 10.222.0.18 () {56 vars in 1374 bytes} [Thu Oct 13 10:58:42 2022] GET /identity/v3/role_assignments?user.id=ed56f3fe2ddc48ee9882712aadaa2001&scope.project.id=112613528384453abe7506465609fbd8&role.id=e6e5c2b89fa04f0ca6cb23159febaa30 => generated 608 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 10:58:42.653141 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8659d81-de19-4457-999e-331048fb8262 None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:42.691869 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ef7dad-5141-4b77-865a-7e6b08061810 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:42.692513 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ef7dad-5141-4b77-865a-7e6b08061810 None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:42.692788 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ef7dad-5141-4b77-865a-7e6b08061810 None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:42.693032 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ef7dad-5141-4b77-865a-7e6b08061810 None admin] PATH_INFO: `/v3/services` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:42.693705 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ef7dad-5141-4b77-865a-7e6b08061810 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81533) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 10:58:42.694008 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ef7dad-5141-4b77-865a-7e6b08061810 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:42.695737 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ef7dad-5141-4b77-865a-7e6b08061810 None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:42.701793 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 362/712] 10.222.0.18 () {56 vars in 1122 bytes} [Thu Oct 13 10:58:42 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 10:58:42.707666 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee70173-a0e8-4cd0-b0f6-22649fc3847f None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:42.736222 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:58:42.842816 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee70173-a0e8-4cd0-b0f6-22649fc3847f None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:42.881378 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95f2ee5-5ea6-44aa-9302-317f8674ee9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:42.883683 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95f2ee5-5ea6-44aa-9302-317f8674ee9a None admin] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:42.884155 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95f2ee5-5ea6-44aa-9302-317f8674ee9a None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:42.884620 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95f2ee5-5ea6-44aa-9302-317f8674ee9a None admin] PATH_INFO: `/v3/endpoints` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:42.885532 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95f2ee5-5ea6-44aa-9302-317f8674ee9a None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:42.887076 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95f2ee5-5ea6-44aa-9302-317f8674ee9a None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:42.908381 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 351/713] 10.222.0.18 () {60 vars in 1144 bytes} [Thu Oct 13 10:58:42 2022] POST /identity/v3/endpoints => generated 349 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 13 10:58:43.645238 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862bd737-5929-4fa0-8e4c-a9df173c4f26 None None] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:43.645638 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862bd737-5929-4fa0-8e4c-a9df173c4f26 None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:43.645835 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862bd737-5929-4fa0-8e4c-a9df173c4f26 None None] PATH_INFO: `/` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:43.647136 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 363/714] 10.222.0.18 () {54 vars in 927 bytes} [Thu Oct 13 10:58:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 10:58:43.653251 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a1fb85-552a-4d17-a873-5377c5e8672d None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:43.653539 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a1fb85-552a-4d17-a873-5377c5e8672d None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:43.653817 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a1fb85-552a-4d17-a873-5377c5e8672d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:43.672449 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-48a1fb85-552a-4d17-a873-5377c5e8672d None None] MFA Rules not processed for user `8ba31ade43694cf8bf28f7528a9ea179`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 10:58:43.673656 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-48a1fb85-552a-4d17-a873-5377c5e8672d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 10:58:43.743091 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:58:43.753895 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 352/715] 10.222.0.18 () {58 vars in 1024 bytes} [Thu Oct 13 10:58:43 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 13 10:58:44.026614 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862bd737-5929-4fa0-8e4c-a9df173c4f26 None None] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:44.034436 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185200e8-7a8a-46a0-b9bb-f997059d9df2 None None] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:44.034893 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185200e8-7a8a-46a0-b9bb-f997059d9df2 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:44.034984 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185200e8-7a8a-46a0-b9bb-f997059d9df2 None None] PATH_INFO: `/` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:44.036318 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 353/716] 10.222.0.18 () {54 vars in 927 bytes} [Thu Oct 13 10:58:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 13 10:58:44.037718 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:58:44.042289 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c282dab4-0a1c-404e-9a36-3397f95f5f65 None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:44.042573 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c282dab4-0a1c-404e-9a36-3397f95f5f65 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:44.042854 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c282dab4-0a1c-404e-9a36-3397f95f5f65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:44.062903 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-c282dab4-0a1c-404e-9a36-3397f95f5f65 None None] MFA Rules not processed for user `8ba31ade43694cf8bf28f7528a9ea179`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 10:58:44.064460 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-c282dab4-0a1c-404e-9a36-3397f95f5f65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 10:58:44.136135 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 354/717] 10.222.0.18 () {58 vars in 1024 bytes} [Thu Oct 13 10:58:44 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 13 10:58:44.152460 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862bd737-5929-4fa0-8e4c-a9df173c4f26 None None] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:44.189646 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca3ae98-8462-47fe-94f8-676613d6fb47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:44.190606 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca3ae98-8462-47fe-94f8-676613d6fb47 None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:44.191083 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca3ae98-8462-47fe-94f8-676613d6fb47 None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:44.191551 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca3ae98-8462-47fe-94f8-676613d6fb47 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:44.192342 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca3ae98-8462-47fe-94f8-676613d6fb47 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:44.193958 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca3ae98-8462-47fe-94f8-676613d6fb47 None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:44.203922 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application [None req-5ca3ae98-8462-47fe-94f8-676613d6fb47 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Oct 13 10:58:44.203922 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 10:58:44.203922 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 13 10:58:44.203922 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 13 10:58:44.203922 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 13 10:58:44.203922 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 13 10:58:44.203922 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 13 10:58:44.203922 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 13 10:58:44.203922 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 13 10:58:44.203922 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application Oct 13 10:58:44.203922 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 13 10:58:44.203922 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application Oct 13 10:58:44.203922 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 10:58:44.203922 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 10:58:44.203922 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 10:58:44.203922 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 10:58:44.203922 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 10:58:44.204936 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 10:58:44.204936 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 10:58:44.204936 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 10:58:44.204936 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 10:58:44.204936 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 10:58:44.204936 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 10:58:44.204936 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 13 10:58:44.204936 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 13 10:58:44.204936 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 13 10:58:44.204936 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 13 10:58:44.204936 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 10:58:44.204936 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 10:58:44.204936 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 10:58:44.204936 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 10:58:44.204936 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 10:58:44.204936 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 10:58:44.205872 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 10:58:44.205872 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application with Lock( Oct 13 10:58:44.205872 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 10:58:44.205872 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._enter() Oct 13 10:58:44.205872 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 10:58:44.205872 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 10:58:44.205872 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 10:58:44.205872 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.creator() Oct 13 10:58:44.205872 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 10:58:44.205872 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application created_value = creator( Oct 13 10:58:44.205872 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 13 10:58:44.205872 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 13 10:58:44.205872 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 13 10:58:44.205872 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application Oct 13 10:58:44.208660 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 364/718] 10.222.0.18 () {56 vars in 1111 bytes} [Thu Oct 13 10:58:44 2022] GET /identity/v3/services/compute => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 10:58:44.215003 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c282dab4-0a1c-404e-9a36-3397f95f5f65 None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:44.318009 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c282dab4-0a1c-404e-9a36-3397f95f5f65 None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:44.345264 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:58:44.354771 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2900aeb4-1831-41dd-af8b-bdba9bc1239c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:44.355636 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2900aeb4-1831-41dd-af8b-bdba9bc1239c None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:44.356115 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2900aeb4-1831-41dd-af8b-bdba9bc1239c None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:44.356600 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2900aeb4-1831-41dd-af8b-bdba9bc1239c None admin] PATH_INFO: `/v3/services` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:44.357482 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2900aeb4-1831-41dd-af8b-bdba9bc1239c None admin] RBAC: Adding query filter params (name=compute) {{(pid=81534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 10:58:44.358025 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2900aeb4-1831-41dd-af8b-bdba9bc1239c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:44.359896 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2900aeb4-1831-41dd-af8b-bdba9bc1239c None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:44.367573 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 355/719] 10.222.0.18 () {56 vars in 1112 bytes} [Thu Oct 13 10:58:44 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 10:58:44.373231 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca3ae98-8462-47fe-94f8-676613d6fb47 None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:44.405702 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2900aeb4-1831-41dd-af8b-bdba9bc1239c None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:44.447912 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:58:44.482350 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca3ae98-8462-47fe-94f8-676613d6fb47 None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:44.508198 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2900aeb4-1831-41dd-af8b-bdba9bc1239c None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:44.518466 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71854ca5-43de-41f5-9f95-91fb22c774e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:44.519317 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71854ca5-43de-41f5-9f95-91fb22c774e4 None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:44.519773 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71854ca5-43de-41f5-9f95-91fb22c774e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:44.520257 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71854ca5-43de-41f5-9f95-91fb22c774e4 None admin] PATH_INFO: `/v3/services` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:44.521051 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71854ca5-43de-41f5-9f95-91fb22c774e4 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81533) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 10:58:44.521502 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71854ca5-43de-41f5-9f95-91fb22c774e4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:44.523083 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71854ca5-43de-41f5-9f95-91fb22c774e4 None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:44.536487 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 365/720] 10.222.0.18 () {56 vars in 1112 bytes} [Thu Oct 13 10:58:44 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 10:58:44.542843 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43606f4-505f-4354-a4cd-202cf6b5470d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:44.543486 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43606f4-505f-4354-a4cd-202cf6b5470d None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:44.543760 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43606f4-505f-4354-a4cd-202cf6b5470d None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:44.544027 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43606f4-505f-4354-a4cd-202cf6b5470d None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:44.544619 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43606f4-505f-4354-a4cd-202cf6b5470d None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:44.546063 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43606f4-505f-4354-a4cd-202cf6b5470d None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:44.556020 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application [None req-b43606f4-505f-4354-a4cd-202cf6b5470d None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 13 10:58:44.556020 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 10:58:44.556020 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 13 10:58:44.556020 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 13 10:58:44.556020 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 13 10:58:44.556020 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 13 10:58:44.556020 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 13 10:58:44.556020 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 13 10:58:44.556020 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 13 10:58:44.556020 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application Oct 13 10:58:44.556020 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 13 10:58:44.556020 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application Oct 13 10:58:44.556020 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 10:58:44.556020 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 10:58:44.556020 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 10:58:44.556020 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 10:58:44.556020 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 10:58:44.557367 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 10:58:44.557367 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 10:58:44.557367 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 10:58:44.557367 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 10:58:44.557367 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 10:58:44.557367 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 10:58:44.557367 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 13 10:58:44.557367 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 13 10:58:44.557367 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 13 10:58:44.557367 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 13 10:58:44.557367 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 10:58:44.557367 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 10:58:44.557367 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 10:58:44.557367 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 10:58:44.557367 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 10:58:44.557367 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 10:58:44.558217 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 10:58:44.558217 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application with Lock( Oct 13 10:58:44.558217 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 10:58:44.558217 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._enter() Oct 13 10:58:44.558217 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 10:58:44.558217 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 10:58:44.558217 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 10:58:44.558217 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.creator() Oct 13 10:58:44.558217 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 10:58:44.558217 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application created_value = creator( Oct 13 10:58:44.558217 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 13 10:58:44.558217 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 13 10:58:44.558217 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 13 10:58:44.558217 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application Oct 13 10:58:44.558217 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 356/721] 10.222.0.18 () {56 vars in 1114 bytes} [Thu Oct 13 10:58:44 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 13 10:58:44.563302 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71854ca5-43de-41f5-9f95-91fb22c774e4 None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:44.674969 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71854ca5-43de-41f5-9f95-91fb22c774e4 None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:44.717438 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37b17ad-118d-4df4-8ac3-5416b801f494 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:44.718484 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37b17ad-118d-4df4-8ac3-5416b801f494 None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:44.718975 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37b17ad-118d-4df4-8ac3-5416b801f494 None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:44.719445 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37b17ad-118d-4df4-8ac3-5416b801f494 None admin] PATH_INFO: `/v3/services` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:44.720286 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37b17ad-118d-4df4-8ac3-5416b801f494 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81533) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 10:58:44.720791 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37b17ad-118d-4df4-8ac3-5416b801f494 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:44.722506 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37b17ad-118d-4df4-8ac3-5416b801f494 None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:44.723995 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:58:44.730612 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 366/722] 10.222.0.18 () {56 vars in 1114 bytes} [Thu Oct 13 10:58:44 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 13 10:58:44.735964 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43606f4-505f-4354-a4cd-202cf6b5470d None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:44.808633 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:58:44.867467 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43606f4-505f-4354-a4cd-202cf6b5470d None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:44.903749 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436835f4-ebe1-4926-93f5-65f729a99fb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:44.904361 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436835f4-ebe1-4926-93f5-65f729a99fb6 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:44.904638 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436835f4-ebe1-4926-93f5-65f729a99fb6 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:44.904910 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436835f4-ebe1-4926-93f5-65f729a99fb6 None admin] PATH_INFO: `/v3/services` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:44.905569 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436835f4-ebe1-4926-93f5-65f729a99fb6 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 10:58:44.905868 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436835f4-ebe1-4926-93f5-65f729a99fb6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:44.907220 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436835f4-ebe1-4926-93f5-65f729a99fb6 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:44.912713 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 357/723] 10.222.0.18 () {56 vars in 1114 bytes} [Thu Oct 13 10:58:44 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 10:58:44.918585 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37b17ad-118d-4df4-8ac3-5416b801f494 None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:44.954831 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fcc1f1-48f9-4ddf-b301-6fb1b2e0a1fd None None] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:44.955455 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fcc1f1-48f9-4ddf-b301-6fb1b2e0a1fd None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:44.955941 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fcc1f1-48f9-4ddf-b301-6fb1b2e0a1fd None None] PATH_INFO: `/` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:44.958663 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 358/724] 10.222.0.18 () {54 vars in 927 bytes} [Thu Oct 13 10:58:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 13 10:58:44.963416 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55c3208-fd5d-415b-9aab-b348ea85c5f2 None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:44.963704 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55c3208-fd5d-415b-9aab-b348ea85c5f2 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:44.963982 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55c3208-fd5d-415b-9aab-b348ea85c5f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:44.982648 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-f55c3208-fd5d-415b-9aab-b348ea85c5f2 None None] MFA Rules not processed for user `8ba31ade43694cf8bf28f7528a9ea179`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 10:58:44.983911 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-f55c3208-fd5d-415b-9aab-b348ea85c5f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 10:58:45.045659 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37b17ad-118d-4df4-8ac3-5416b801f494 None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:45.064265 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 359/725] 10.222.0.18 () {58 vars in 1024 bytes} [Thu Oct 13 10:58:44 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 13 10:58:45.092734 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee8eaa2-5eb3-4474-a1cf-6a3435f3c450 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:45.093456 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee8eaa2-5eb3-4474-a1cf-6a3435f3c450 None admin] REQUEST_METHOD: `POST` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:45.093734 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee8eaa2-5eb3-4474-a1cf-6a3435f3c450 None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:45.094005 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee8eaa2-5eb3-4474-a1cf-6a3435f3c450 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:45.094823 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee8eaa2-5eb3-4474-a1cf-6a3435f3c450 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:45.096240 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee8eaa2-5eb3-4474-a1cf-6a3435f3c450 None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:45.122600 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 367/726] 10.222.0.18 () {60 vars in 1144 bytes} [Thu Oct 13 10:58:44 2022] POST /identity/v3/endpoints => generated 346 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 13 10:58:45.208037 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3caa0421-1112-4e59-98be-510a431aa962 None None] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:45.208220 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3caa0421-1112-4e59-98be-510a431aa962 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:45.208505 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3caa0421-1112-4e59-98be-510a431aa962 None None] PATH_INFO: `/` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:45.210213 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 360/727] 10.222.0.18 () {54 vars in 927 bytes} [Thu Oct 13 10:58:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 10:58:45.215855 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d467b9-4065-4354-ae92-2398613494ad None None] REQUEST_METHOD: `POST` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:45.216140 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d467b9-4065-4354-ae92-2398613494ad None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:45.216413 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d467b9-4065-4354-ae92-2398613494ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:45.237422 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.auth.core [None req-20d467b9-4065-4354-ae92-2398613494ad None None] MFA Rules not processed for user `8ba31ade43694cf8bf28f7528a9ea179`. Rule list: `[]` (Enabled: `True`). {{(pid=81533) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 10:58:45.238628 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-20d467b9-4065-4354-ae92-2398613494ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 10:58:45.298026 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:58:45.325572 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 368/728] 10.222.0.18 () {58 vars in 1024 bytes} [Thu Oct 13 10:58:45 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 13 10:58:45.338319 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3caa0421-1112-4e59-98be-510a431aa962 None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:45.394506 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:58:45.454217 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3caa0421-1112-4e59-98be-510a431aa962 None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:45.490290 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c4f2b0-1ce6-4540-a9a7-6936f0663cc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:45.490847 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c4f2b0-1ce6-4540-a9a7-6936f0663cc0 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:45.491713 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c4f2b0-1ce6-4540-a9a7-6936f0663cc0 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:45.491995 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c4f2b0-1ce6-4540-a9a7-6936f0663cc0 None admin] PATH_INFO: `/v3/services/image` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:45.492636 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c4f2b0-1ce6-4540-a9a7-6936f0663cc0 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:45.494032 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c4f2b0-1ce6-4540-a9a7-6936f0663cc0 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:45.503276 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application [None req-b5c4f2b0-1ce6-4540-a9a7-6936f0663cc0 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Oct 13 10:58:45.503276 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 10:58:45.503276 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 13 10:58:45.503276 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 13 10:58:45.503276 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 13 10:58:45.503276 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 13 10:58:45.503276 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 13 10:58:45.503276 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 13 10:58:45.503276 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 13 10:58:45.503276 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application Oct 13 10:58:45.503276 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 13 10:58:45.503276 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application Oct 13 10:58:45.503276 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 10:58:45.503276 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 10:58:45.503276 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 10:58:45.503276 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 10:58:45.503276 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 10:58:45.504300 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 10:58:45.504300 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 10:58:45.504300 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 10:58:45.504300 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 10:58:45.504300 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 10:58:45.504300 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 10:58:45.504300 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 13 10:58:45.504300 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 13 10:58:45.504300 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 13 10:58:45.504300 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 13 10:58:45.504300 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 10:58:45.504300 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 10:58:45.504300 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 10:58:45.504300 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 10:58:45.504300 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 10:58:45.504300 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 10:58:45.505189 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 10:58:45.505189 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application with Lock( Oct 13 10:58:45.505189 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 10:58:45.505189 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._enter() Oct 13 10:58:45.505189 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 10:58:45.505189 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 10:58:45.505189 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 10:58:45.505189 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.creator() Oct 13 10:58:45.505189 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 10:58:45.505189 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application created_value = creator( Oct 13 10:58:45.505189 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 13 10:58:45.505189 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 13 10:58:45.505189 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 13 10:58:45.505189 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application Oct 13 10:58:45.505189 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 361/729] 10.222.0.18 () {56 vars in 1105 bytes} [Thu Oct 13 10:58:45 2022] GET /identity/v3/services/image => generated 86 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 10:58:45.510869 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d467b9-4065-4354-ae92-2398613494ad None None] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:45.616781 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c4f2b0-1ce6-4540-a9a7-6936f0663cc0 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:45.626176 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d467b9-4065-4354-ae92-2398613494ad None None] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:45.679340 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e8956d-e435-406d-a188-02612d007111 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:45.679957 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e8956d-e435-406d-a188-02612d007111 None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:45.680236 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e8956d-e435-406d-a188-02612d007111 None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:45.680508 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e8956d-e435-406d-a188-02612d007111 None admin] PATH_INFO: `/v3/services` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:45.681176 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e8956d-e435-406d-a188-02612d007111 None admin] RBAC: Adding query filter params (name=image) {{(pid=81533) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 10:58:45.681482 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e8956d-e435-406d-a188-02612d007111 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:45.682860 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e8956d-e435-406d-a188-02612d007111 None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:45.688011 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 369/730] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Oct 13 10:58:45 2022] GET /identity/v3/services?name=image => generated 122 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 10:58:45.693679 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e8956d-e435-406d-a188-02612d007111 None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:45.752863 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c4f2b0-1ce6-4540-a9a7-6936f0663cc0 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:45.758580 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:58:45.768390 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:58:45.793181 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78f223c-08d5-47e4-886f-02faa7da3ef5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:45.794341 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78f223c-08d5-47e4-886f-02faa7da3ef5 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:45.794341 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78f223c-08d5-47e4-886f-02faa7da3ef5 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:45.794829 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78f223c-08d5-47e4-886f-02faa7da3ef5 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:45.795507 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78f223c-08d5-47e4-886f-02faa7da3ef5 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:45.796966 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78f223c-08d5-47e4-886f-02faa7da3ef5 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:45.807409 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application [None req-e78f223c-08d5-47e4-886f-02faa7da3ef5 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 13 10:58:45.807409 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 10:58:45.807409 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 13 10:58:45.807409 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 13 10:58:45.807409 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 13 10:58:45.807409 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 13 10:58:45.807409 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 13 10:58:45.807409 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 13 10:58:45.807409 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 13 10:58:45.807409 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application Oct 13 10:58:45.807409 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 13 10:58:45.807409 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application Oct 13 10:58:45.807409 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 10:58:45.807409 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 10:58:45.807409 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 10:58:45.807409 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 10:58:45.807409 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 10:58:45.808667 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 10:58:45.808667 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 10:58:45.808667 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 10:58:45.808667 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 10:58:45.808667 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 10:58:45.808667 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 10:58:45.808667 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 13 10:58:45.808667 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 13 10:58:45.808667 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 13 10:58:45.808667 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 13 10:58:45.808667 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 10:58:45.808667 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 10:58:45.808667 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 10:58:45.808667 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 10:58:45.808667 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 10:58:45.808667 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 10:58:45.809643 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 10:58:45.809643 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application with Lock( Oct 13 10:58:45.809643 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 10:58:45.809643 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._enter() Oct 13 10:58:45.809643 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 10:58:45.809643 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 10:58:45.809643 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 10:58:45.809643 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.creator() Oct 13 10:58:45.809643 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 10:58:45.809643 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application created_value = creator( Oct 13 10:58:45.809643 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 13 10:58:45.809643 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 13 10:58:45.809643 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 13 10:58:45.809643 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application Oct 13 10:58:45.815412 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 362/731] 10.222.0.18 () {56 vars in 1126 bytes} [Thu Oct 13 10:58:45 2022] GET /identity/v3/services/object-store => generated 93 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 13 10:58:45.816358 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78f223c-08d5-47e4-886f-02faa7da3ef5 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:45.833467 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e8956d-e435-406d-a188-02612d007111 None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:45.874939 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc2c823-fe18-458a-9524-0fa0db05227f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:45.875512 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc2c823-fe18-458a-9524-0fa0db05227f None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:45.875860 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc2c823-fe18-458a-9524-0fa0db05227f None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:45.876204 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc2c823-fe18-458a-9524-0fa0db05227f None admin] PATH_INFO: `/v3/services` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:45.876928 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc2c823-fe18-458a-9524-0fa0db05227f None admin] RBAC: Adding query filter params (type=image) {{(pid=81533) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 10:58:45.877325 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc2c823-fe18-458a-9524-0fa0db05227f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:45.878935 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc2c823-fe18-458a-9524-0fa0db05227f None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:45.885051 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 370/732] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Oct 13 10:58:45 2022] GET /identity/v3/services?type=image => generated 122 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 10:58:45.953047 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78f223c-08d5-47e4-886f-02faa7da3ef5 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:45.993930 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9dfbdd-f4db-405c-a83d-34f2ac84981e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:45.994549 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9dfbdd-f4db-405c-a83d-34f2ac84981e None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:45.994829 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9dfbdd-f4db-405c-a83d-34f2ac84981e None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:45.995110 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9dfbdd-f4db-405c-a83d-34f2ac84981e None admin] PATH_INFO: `/v3/services` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:45.995753 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9dfbdd-f4db-405c-a83d-34f2ac84981e None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 10:58:45.996055 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9dfbdd-f4db-405c-a83d-34f2ac84981e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:45.997483 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9dfbdd-f4db-405c-a83d-34f2ac84981e None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:46.003385 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 363/733] 10.222.0.18 () {56 vars in 1122 bytes} [Thu Oct 13 10:58:45 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 10:58:46.010189 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc2c823-fe18-458a-9524-0fa0db05227f None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:46.126999 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc2c823-fe18-458a-9524-0fa0db05227f None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:46.138268 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:58:46.165229 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00329856-c103-46f2-b994-6f6968f7d7aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:46.165837 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00329856-c103-46f2-b994-6f6968f7d7aa None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:46.166114 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00329856-c103-46f2-b994-6f6968f7d7aa None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:46.166385 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00329856-c103-46f2-b994-6f6968f7d7aa None admin] PATH_INFO: `/v3/services` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:46.167014 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00329856-c103-46f2-b994-6f6968f7d7aa None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81533) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 10:58:46.167312 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00329856-c103-46f2-b994-6f6968f7d7aa None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:46.168666 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00329856-c103-46f2-b994-6f6968f7d7aa None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:46.173980 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 371/734] 10.222.0.18 () {56 vars in 1122 bytes} [Thu Oct 13 10:58:46 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 10:58:46.180069 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9dfbdd-f4db-405c-a83d-34f2ac84981e None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:46.228952 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:58:46.292326 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9dfbdd-f4db-405c-a83d-34f2ac84981e None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:46.330915 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c85d8e-a851-4b3f-b33e-72bb20ccc17d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:46.331517 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c85d8e-a851-4b3f-b33e-72bb20ccc17d None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:46.331788 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c85d8e-a851-4b3f-b33e-72bb20ccc17d None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:46.332059 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c85d8e-a851-4b3f-b33e-72bb20ccc17d None admin] PATH_INFO: `/v3/endpoints` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:46.332833 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c85d8e-a851-4b3f-b33e-72bb20ccc17d None admin] RBAC: Adding query filter params (interface=admin, service_id=1255fa7b96b845818e6fa3ae819fe995, region_id=RegionOne) {{(pid=81534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 10:58:46.333188 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c85d8e-a851-4b3f-b33e-72bb20ccc17d None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:46.334546 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c85d8e-a851-4b3f-b33e-72bb20ccc17d None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:46.340798 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 364/735] 10.222.0.18 () {56 vars in 1249 bytes} [Thu Oct 13 10:58:46 2022] GET /identity/v3/endpoints?service_id=1255fa7b96b845818e6fa3ae819fe995&interface=admin®ion_id=RegionOne => generated 193 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 10:58:46.346338 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00329856-c103-46f2-b994-6f6968f7d7aa None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:46.454600 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00329856-c103-46f2-b994-6f6968f7d7aa None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:46.490471 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5647ab1c-d775-4022-a9d2-b3992d689663 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:46.491667 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5647ab1c-d775-4022-a9d2-b3992d689663 None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:46.491998 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5647ab1c-d775-4022-a9d2-b3992d689663 None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:46.492443 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5647ab1c-d775-4022-a9d2-b3992d689663 None admin] PATH_INFO: `/v3/services` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:46.493078 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5647ab1c-d775-4022-a9d2-b3992d689663 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:46.494442 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5647ab1c-d775-4022-a9d2-b3992d689663 None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:46.500923 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 372/736] 10.222.0.18 () {56 vars in 1087 bytes} [Thu Oct 13 10:58:46 2022] GET /identity/v3/services => generated 1497 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 13 10:58:46.828914 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdf6fa1-2a6c-41d9-8dc3-98f5abe24ecc None None] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:46.829218 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdf6fa1-2a6c-41d9-8dc3-98f5abe24ecc None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:46.829502 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdf6fa1-2a6c-41d9-8dc3-98f5abe24ecc None None] PATH_INFO: `/` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:46.831113 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 365/737] 10.222.0.18 () {54 vars in 927 bytes} [Thu Oct 13 10:58:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 10:58:46.836883 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef2970a-a801-47e1-8942-335688e8d463 None None] REQUEST_METHOD: `POST` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:46.837196 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef2970a-a801-47e1-8942-335688e8d463 None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:46.837475 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef2970a-a801-47e1-8942-335688e8d463 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:46.858120 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.auth.core [None req-2ef2970a-a801-47e1-8942-335688e8d463 None None] MFA Rules not processed for user `8ba31ade43694cf8bf28f7528a9ea179`. Rule list: `[]` (Enabled: `True`). {{(pid=81533) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 10:58:46.859343 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-2ef2970a-a801-47e1-8942-335688e8d463 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 10:58:46.890310 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:58:46.936931 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 373/738] 10.222.0.18 () {58 vars in 1024 bytes} [Thu Oct 13 10:58:46 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 13 10:58:47.202709 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acdf6fa1-2a6c-41d9-8dc3-98f5abe24ecc None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:47.311537 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acdf6fa1-2a6c-41d9-8dc3-98f5abe24ecc None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:47.314544 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:58:47.352487 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af8cdb0-bc0a-43a7-9492-5e55eeeec1b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:47.353135 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af8cdb0-bc0a-43a7-9492-5e55eeeec1b1 None admin] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:47.353415 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af8cdb0-bc0a-43a7-9492-5e55eeeec1b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:47.353688 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af8cdb0-bc0a-43a7-9492-5e55eeeec1b1 None admin] PATH_INFO: `/v3/services` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:47.354422 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af8cdb0-bc0a-43a7-9492-5e55eeeec1b1 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:47.355818 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af8cdb0-bc0a-43a7-9492-5e55eeeec1b1 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:47.377266 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 366/739] 10.222.0.18 () {60 vars in 1141 bytes} [Thu Oct 13 10:58:47 2022] POST /identity/v3/services => generated 242 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 13 10:58:47.445634 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beebbe3e-3e4a-48e7-bb21-5279c9b1cde5 None None] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:47.446289 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beebbe3e-3e4a-48e7-bb21-5279c9b1cde5 None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:47.446289 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beebbe3e-3e4a-48e7-bb21-5279c9b1cde5 None None] PATH_INFO: `/` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:47.448010 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 374/740] 10.222.0.18 () {54 vars in 927 bytes} [Thu Oct 13 10:58:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 10:58:47.454682 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbb3fc9-ed57-4bf9-820a-16fd577ee198 None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:47.454951 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbb3fc9-ed57-4bf9-820a-16fd577ee198 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:47.455162 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbb3fc9-ed57-4bf9-820a-16fd577ee198 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:47.474612 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-8cbb3fc9-ed57-4bf9-820a-16fd577ee198 None None] MFA Rules not processed for user `8ba31ade43694cf8bf28f7528a9ea179`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 10:58:47.476619 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-8cbb3fc9-ed57-4bf9-820a-16fd577ee198 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 10:58:47.558994 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 367/741] 10.222.0.18 () {58 vars in 1024 bytes} [Thu Oct 13 10:58:47 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 13 10:58:47.829756 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beebbe3e-3e4a-48e7-bb21-5279c9b1cde5 None None] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:47.937732 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beebbe3e-3e4a-48e7-bb21-5279c9b1cde5 None None] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:47.974456 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d638bb-e7ba-4f3b-bd31-1d25e98a1962 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:47.976024 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d638bb-e7ba-4f3b-bd31-1d25e98a1962 None admin] REQUEST_METHOD: `POST` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:47.976705 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d638bb-e7ba-4f3b-bd31-1d25e98a1962 None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:47.977208 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d638bb-e7ba-4f3b-bd31-1d25e98a1962 None admin] PATH_INFO: `/v3/projects` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:47.978058 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d638bb-e7ba-4f3b-bd31-1d25e98a1962 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:47.979712 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d638bb-e7ba-4f3b-bd31-1d25e98a1962 None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:47.982591 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: WARNING keystone.server.flask.common [None req-27d638bb-e7ba-4f3b-bd31-1d25e98a1962 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Oct 13 10:58:48.002353 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.sql.core [None req-27d638bb-e7ba-4f3b-bd31-1d25e98a1962 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Oct 13 10:58:48.002353 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Oct 13 10:58:48.002353 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: [parameters: {'id': '92702d54132f4a6e8a5e0a8be76c0fd3', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Oct 13 10:58:48.002353 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81533) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Oct 13 10:58:48.011347 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application [None req-27d638bb-e7ba-4f3b-bd31-1d25e98a1962 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 92702d54132f4a6e8a5e0a8be76c0fd3.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 92702d54132f4a6e8a5e0a8be76c0fd3. Oct 13 10:58:48.011347 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 10:58:48.011347 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 13 10:58:48.011347 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 13 10:58:48.011347 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 13 10:58:48.011347 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 13 10:58:48.011347 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 13 10:58:48.011347 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application result = self._query(query) Oct 13 10:58:48.011347 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 13 10:58:48.011347 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application conn.query(q) Oct 13 10:58:48.011347 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 13 10:58:48.011347 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 13 10:58:48.011347 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 13 10:58:48.012167 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application result.read() Oct 13 10:58:48.012167 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 13 10:58:48.012167 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 13 10:58:48.012167 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 13 10:58:48.012167 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 13 10:58:48.012167 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 13 10:58:48.012167 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 13 10:58:48.012167 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 13 10:58:48.012167 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 13 10:58:48.012167 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Oct 13 10:58:48.012167 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application Oct 13 10:58:48.012167 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Oct 13 10:58:48.012167 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application Oct 13 10:58:48.012167 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 10:58:48.012167 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Oct 13 10:58:48.012167 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return method(*args, **kwargs) Oct 13 10:58:48.012167 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Oct 13 10:58:48.012167 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return project_ref.to_dict() Oct 13 10:58:48.013204 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 13 10:58:48.013204 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application next(self.gen) Oct 13 10:58:48.013204 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Oct 13 10:58:48.013204 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application yield resource Oct 13 10:58:48.013204 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 13 10:58:48.013204 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application next(self.gen) Oct 13 10:58:48.013204 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Oct 13 10:58:48.013204 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application self.session.rollback() Oct 13 10:58:48.013204 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 13 10:58:48.013204 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application self.force_reraise() Oct 13 10:58:48.013204 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 13 10:58:48.013204 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application raise self.value Oct 13 10:58:48.013204 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Oct 13 10:58:48.013204 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Oct 13 10:58:48.013204 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Oct 13 10:58:48.013204 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application session.commit() Oct 13 10:58:48.013204 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Oct 13 10:58:48.014198 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Oct 13 10:58:48.014198 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Oct 13 10:58:48.014198 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application self._prepare_impl() Oct 13 10:58:48.014198 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Oct 13 10:58:48.014198 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application self.session.flush() Oct 13 10:58:48.014198 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 13 10:58:48.014198 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application self._flush(objects) Oct 13 10:58:48.014198 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 13 10:58:48.014198 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Oct 13 10:58:48.014198 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 13 10:58:48.014198 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application compat.raise_( Oct 13 10:58:48.014198 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 13 10:58:48.014198 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application raise exception Oct 13 10:58:48.014198 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 13 10:58:48.014198 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application flush_context.execute() Oct 13 10:58:48.014198 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 13 10:58:48.014198 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application rec.execute(self) Oct 13 10:58:48.015144 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 13 10:58:48.015144 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Oct 13 10:58:48.015144 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 13 10:58:48.015144 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application _emit_insert_statements( Oct 13 10:58:48.015144 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Oct 13 10:58:48.015144 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application c = connection._execute_20( Oct 13 10:58:48.015144 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 13 10:58:48.015144 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Oct 13 10:58:48.015144 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 13 10:58:48.015144 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Oct 13 10:58:48.015144 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 13 10:58:48.015144 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application ret = self._execute_context( Oct 13 10:58:48.015144 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 13 10:58:48.015144 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Oct 13 10:58:48.015144 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 13 10:58:48.015963 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 13 10:58:48.015963 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 13 10:58:48.015963 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application raise exception Oct 13 10:58:48.015963 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 13 10:58:48.015963 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 13 10:58:48.015963 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 13 10:58:48.015963 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 13 10:58:48.015963 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 13 10:58:48.015963 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application result = self._query(query) Oct 13 10:58:48.015963 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 13 10:58:48.015963 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application conn.query(q) Oct 13 10:58:48.015963 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 13 10:58:48.015963 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 13 10:58:48.015963 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 13 10:58:48.015963 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application result.read() Oct 13 10:58:48.015963 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 13 10:58:48.015963 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 13 10:58:48.016857 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 13 10:58:48.016857 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 13 10:58:48.016857 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 13 10:58:48.016857 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 13 10:58:48.016857 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 13 10:58:48.016857 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 13 10:58:48.016857 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Oct 13 10:58:48.016857 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Oct 13 10:58:48.016857 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application [parameters: {'id': '92702d54132f4a6e8a5e0a8be76c0fd3', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Oct 13 10:58:48.016857 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 13 10:58:48.016857 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application Oct 13 10:58:48.016857 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 13 10:58:48.016857 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application Oct 13 10:58:48.016857 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 10:58:48.016857 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Oct 13 10:58:48.019615 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Oct 13 10:58:48.019615 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Oct 13 10:58:48.019615 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Oct 13 10:58:48.019615 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Oct 13 10:58:48.019615 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application Oct 13 10:58:48.019615 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 13 10:58:48.019615 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application Oct 13 10:58:48.019615 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 10:58:48.019615 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 10:58:48.019615 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 10:58:48.019615 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 10:58:48.019615 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 10:58:48.019615 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 10:58:48.019615 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 10:58:48.019615 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 10:58:48.019615 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 10:58:48.019615 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 10:58:48.021862 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 10:58:48.021862 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Oct 13 10:58:48.021862 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Oct 13 10:58:48.021862 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 10:58:48.021862 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 10:58:48.021862 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Oct 13 10:58:48.021862 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application raise exception.Conflict( Oct 13 10:58:48.021862 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 92702d54132f4a6e8a5e0a8be76c0fd3. Oct 13 10:58:48.021862 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application Oct 13 10:58:48.029772 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 375/742] 10.222.0.18 () {60 vars in 1140 bytes} [Thu Oct 13 10:58:47 2022] POST /identity/v3/projects => generated 262 bytes in 200 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Oct 13 10:58:48.033062 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbb3fc9-ed57-4bf9-820a-16fd577ee198 None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:48.129732 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:58:48.140690 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbb3fc9-ed57-4bf9-820a-16fd577ee198 None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:48.153340 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7f6517-3b18-4899-9ed5-6cb28577811d None None] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:48.153639 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7f6517-3b18-4899-9ed5-6cb28577811d None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:48.153885 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7f6517-3b18-4899-9ed5-6cb28577811d None None] PATH_INFO: `/` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:48.158499 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 376/743] 10.222.0.18 () {54 vars in 927 bytes} [Thu Oct 13 10:58:48 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 10:58:48.165026 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07358cc3-2ea2-4012-ac9f-d63ba5bdff14 None None] REQUEST_METHOD: `POST` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:48.165234 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07358cc3-2ea2-4012-ac9f-d63ba5bdff14 None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:48.165509 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07358cc3-2ea2-4012-ac9f-d63ba5bdff14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:48.184531 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.auth.core [None req-07358cc3-2ea2-4012-ac9f-d63ba5bdff14 None None] MFA Rules not processed for user `8ba31ade43694cf8bf28f7528a9ea179`. Rule list: `[]` (Enabled: `True`). {{(pid=81533) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 10:58:48.184737 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3369fe57-bf67-47fe-abc0-97051329cf12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:48.185294 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3369fe57-bf67-47fe-abc0-97051329cf12 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:48.185574 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3369fe57-bf67-47fe-abc0-97051329cf12 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:48.185850 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3369fe57-bf67-47fe-abc0-97051329cf12 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:48.186067 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-07358cc3-2ea2-4012-ac9f-d63ba5bdff14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 10:58:48.193127 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3369fe57-bf67-47fe-abc0-97051329cf12 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:48.195146 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3369fe57-bf67-47fe-abc0-97051329cf12 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:48.207311 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:58:48.209182 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application [None req-3369fe57-bf67-47fe-abc0-97051329cf12 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 13 10:58:48.209182 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 10:58:48.209182 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 10:58:48.209182 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 10:58:48.209182 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 10:58:48.209182 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 10:58:48.209182 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 10:58:48.209182 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 10:58:48.209182 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 10:58:48.209182 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 10:58:48.209182 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 10:58:48.209182 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 10:58:48.209182 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 13 10:58:48.209182 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 13 10:58:48.209182 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 13 10:58:48.210730 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 13 10:58:48.210730 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 10:58:48.210730 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 10:58:48.210730 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 10:58:48.210730 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 10:58:48.210730 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 10:58:48.210730 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 10:58:48.210730 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 10:58:48.210730 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application with Lock( Oct 13 10:58:48.210730 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 10:58:48.210730 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._enter() Oct 13 10:58:48.210730 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 10:58:48.210730 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 10:58:48.210730 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 10:58:48.210730 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.creator() Oct 13 10:58:48.210730 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 10:58:48.210730 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application created_value = creator( Oct 13 10:58:48.211838 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 13 10:58:48.211838 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 13 10:58:48.211838 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 13 10:58:48.211838 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 13 10:58:48.211838 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 13 10:58:48.211838 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 13 10:58:48.211838 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 13 10:58:48.211838 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application Oct 13 10:58:48.211838 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 368/744] 10.222.0.18 () {56 vars in 1111 bytes} [Thu Oct 13 10:58:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 10:58:48.216859 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3369fe57-bf67-47fe-abc0-97051329cf12 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:48.274007 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 377/745] 10.222.0.18 () {58 vars in 1024 bytes} [Thu Oct 13 10:58:48 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 13 10:58:48.332584 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3369fe57-bf67-47fe-abc0-97051329cf12 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:48.370679 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a17435-9671-411c-902a-83a5f5732b5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:48.371288 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a17435-9671-411c-902a-83a5f5732b5c None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:48.371569 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a17435-9671-411c-902a-83a5f5732b5c None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:48.371843 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a17435-9671-411c-902a-83a5f5732b5c None admin] PATH_INFO: `/v3/projects` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:48.372514 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a17435-9671-411c-902a-83a5f5732b5c None admin] RBAC: Adding query filter params (name=service) {{(pid=81534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 10:58:48.372819 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a17435-9671-411c-902a-83a5f5732b5c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:48.374516 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a17435-9671-411c-902a-83a5f5732b5c None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:48.394208 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 369/746] 10.222.0.18 () {56 vars in 1112 bytes} [Thu Oct 13 10:58:48 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 10:58:48.550804 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07358cc3-2ea2-4012-ac9f-d63ba5bdff14 None None] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:48.659532 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07358cc3-2ea2-4012-ac9f-d63ba5bdff14 None None] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:48.700146 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7219f477-775a-463e-99b6-533d73918c40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:48.700758 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7219f477-775a-463e-99b6-533d73918c40 None admin] REQUEST_METHOD: `POST` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:48.701054 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7219f477-775a-463e-99b6-533d73918c40 None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:48.701334 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7219f477-775a-463e-99b6-533d73918c40 None admin] PATH_INFO: `/v3/services` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:48.702003 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7219f477-775a-463e-99b6-533d73918c40 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:48.703480 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7219f477-775a-463e-99b6-533d73918c40 None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:48.720405 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 378/747] 10.222.0.18 () {60 vars in 1141 bytes} [Thu Oct 13 10:58:48 2022] POST /identity/v3/services => generated 242 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 13 10:58:48.799578 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cdd4a8-8d07-45e0-8801-96417c6dd9f6 None None] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:48.799953 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cdd4a8-8d07-45e0-8801-96417c6dd9f6 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:48.800126 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cdd4a8-8d07-45e0-8801-96417c6dd9f6 None None] PATH_INFO: `/` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:48.801897 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 370/748] 10.222.0.18 () {54 vars in 927 bytes} [Thu Oct 13 10:58:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 10:58:48.808553 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f618e5-9418-4872-b72c-cc48d65b151f None None] REQUEST_METHOD: `POST` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:48.808880 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f618e5-9418-4872-b72c-cc48d65b151f None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:48.809144 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f618e5-9418-4872-b72c-cc48d65b151f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:48.829176 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.auth.core [None req-e5f618e5-9418-4872-b72c-cc48d65b151f None None] MFA Rules not processed for user `8ba31ade43694cf8bf28f7528a9ea179`. Rule list: `[]` (Enabled: `True`). {{(pid=81533) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 10:58:48.830531 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-e5f618e5-9418-4872-b72c-cc48d65b151f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 10:58:48.840385 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:58:48.915990 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 379/749] 10.222.0.18 () {58 vars in 1024 bytes} [Thu Oct 13 10:58:48 2022] POST /identity/v3/auth/tokens => generated 1666 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 13 10:58:49.183178 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04cdd4a8-8d07-45e0-8801-96417c6dd9f6 None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:49.197507 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:58:49.292501 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04cdd4a8-8d07-45e0-8801-96417c6dd9f6 None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:49.328308 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ef8238-145b-4be6-8fb9-a389821ffa71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:49.328937 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ef8238-145b-4be6-8fb9-a389821ffa71 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:49.329284 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ef8238-145b-4be6-8fb9-a389821ffa71 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:49.329553 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ef8238-145b-4be6-8fb9-a389821ffa71 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:49.330133 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ef8238-145b-4be6-8fb9-a389821ffa71 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:49.331483 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ef8238-145b-4be6-8fb9-a389821ffa71 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:49.341267 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application [None req-10ef8238-145b-4be6-8fb9-a389821ffa71 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 13 10:58:49.341267 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 10:58:49.341267 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 13 10:58:49.341267 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 13 10:58:49.341267 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 13 10:58:49.341267 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 13 10:58:49.341267 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 13 10:58:49.341267 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 13 10:58:49.341267 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 13 10:58:49.341267 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application Oct 13 10:58:49.341267 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 13 10:58:49.341267 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application Oct 13 10:58:49.341267 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 10:58:49.341267 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 10:58:49.341267 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 10:58:49.341267 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 10:58:49.341267 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 10:58:49.342373 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 10:58:49.342373 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 10:58:49.342373 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 10:58:49.342373 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 10:58:49.342373 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 10:58:49.342373 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 10:58:49.342373 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 13 10:58:49.342373 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 13 10:58:49.342373 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 13 10:58:49.342373 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 13 10:58:49.342373 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 10:58:49.342373 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 10:58:49.342373 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 10:58:49.342373 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 10:58:49.342373 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 10:58:49.342373 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 10:58:49.343219 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 10:58:49.343219 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application with Lock( Oct 13 10:58:49.343219 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 10:58:49.343219 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._enter() Oct 13 10:58:49.343219 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 10:58:49.343219 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 10:58:49.343219 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 10:58:49.343219 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.creator() Oct 13 10:58:49.343219 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 10:58:49.343219 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application created_value = creator( Oct 13 10:58:49.343219 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 13 10:58:49.343219 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 13 10:58:49.343219 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 13 10:58:49.343219 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application Oct 13 10:58:49.343219 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 371/750] 10.222.0.18 () {56 vars in 1126 bytes} [Thu Oct 13 10:58:49 2022] GET /identity/v3/services/object-store => generated 93 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 10:58:49.348510 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f618e5-9418-4872-b72c-cc48d65b151f None None] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:49.454519 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f618e5-9418-4872-b72c-cc48d65b151f None None] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:49.489991 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03434f0-5618-413c-9934-206db521b619 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:49.490645 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03434f0-5618-413c-9934-206db521b619 None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:49.491444 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03434f0-5618-413c-9934-206db521b619 None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:49.491930 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03434f0-5618-413c-9934-206db521b619 None admin] PATH_INFO: `/v3/services` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:49.492735 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03434f0-5618-413c-9934-206db521b619 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81533) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 10:58:49.493050 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03434f0-5618-413c-9934-206db521b619 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:49.494409 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03434f0-5618-413c-9934-206db521b619 None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:49.499941 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 380/751] 10.222.0.18 () {56 vars in 1122 bytes} [Thu Oct 13 10:58:49 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 10:58:49.505659 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ef8238-145b-4be6-8fb9-a389821ffa71 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:49.601755 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:58:49.614050 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ef8238-145b-4be6-8fb9-a389821ffa71 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:49.648639 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64beab2-4315-400f-92a8-4577b0f08bdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:49.649269 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64beab2-4315-400f-92a8-4577b0f08bdc None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:49.649617 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64beab2-4315-400f-92a8-4577b0f08bdc None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:49.649883 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64beab2-4315-400f-92a8-4577b0f08bdc None admin] PATH_INFO: `/v3/services` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:49.650503 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64beab2-4315-400f-92a8-4577b0f08bdc None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 10:58:49.650799 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64beab2-4315-400f-92a8-4577b0f08bdc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:49.652248 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64beab2-4315-400f-92a8-4577b0f08bdc None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:49.657639 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 372/752] 10.222.0.18 () {56 vars in 1122 bytes} [Thu Oct 13 10:58:49 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 10:58:49.663769 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03434f0-5618-413c-9934-206db521b619 None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:49.666664 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:58:49.683503 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa73bbb-9b52-416f-9125-c52a1fcc4769 None None] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:49.683823 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa73bbb-9b52-416f-9125-c52a1fcc4769 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:49.684097 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa73bbb-9b52-416f-9125-c52a1fcc4769 None None] PATH_INFO: `/` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:49.685817 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 373/753] 10.222.0.18 () {54 vars in 927 bytes} [Thu Oct 13 10:58:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 10:58:49.696471 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c136d63e-517f-48ee-9acd-b5117882fa6a None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:49.696815 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c136d63e-517f-48ee-9acd-b5117882fa6a None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:49.697048 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c136d63e-517f-48ee-9acd-b5117882fa6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:49.719402 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-c136d63e-517f-48ee-9acd-b5117882fa6a None None] MFA Rules not processed for user `8ba31ade43694cf8bf28f7528a9ea179`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 10:58:49.720916 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-c136d63e-517f-48ee-9acd-b5117882fa6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 10:58:49.790881 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03434f0-5618-413c-9934-206db521b619 None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:49.805032 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 374/754] 10.222.0.18 () {58 vars in 1024 bytes} [Thu Oct 13 10:58:49 2022] POST /identity/v3/auth/tokens => generated 1666 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 13 10:58:49.832601 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb2fc4a-f0aa-45d0-847a-62ec1a35a2b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:49.833294 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb2fc4a-f0aa-45d0-847a-62ec1a35a2b0 None admin] REQUEST_METHOD: `POST` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:49.833577 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb2fc4a-f0aa-45d0-847a-62ec1a35a2b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:49.833844 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb2fc4a-f0aa-45d0-847a-62ec1a35a2b0 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:49.834561 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb2fc4a-f0aa-45d0-847a-62ec1a35a2b0 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:49.836304 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb2fc4a-f0aa-45d0-847a-62ec1a35a2b0 None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:49.855631 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 381/755] 10.222.0.18 () {60 vars in 1144 bytes} [Thu Oct 13 10:58:49 2022] POST /identity/v3/endpoints => generated 325 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 13 10:58:50.082351 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c136d63e-517f-48ee-9acd-b5117882fa6a None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:50.155827 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:58:50.194089 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c136d63e-517f-48ee-9acd-b5117882fa6a None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:50.235123 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0299e827-4307-45a0-a3d7-8d30349ce044 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:50.235755 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0299e827-4307-45a0-a3d7-8d30349ce044 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:50.236028 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0299e827-4307-45a0-a3d7-8d30349ce044 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:50.236292 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0299e827-4307-45a0-a3d7-8d30349ce044 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:50.236867 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0299e827-4307-45a0-a3d7-8d30349ce044 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:50.238365 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0299e827-4307-45a0-a3d7-8d30349ce044 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:50.247180 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application [None req-0299e827-4307-45a0-a3d7-8d30349ce044 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Oct 13 10:58:50.247180 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 10:58:50.247180 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 13 10:58:50.247180 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 13 10:58:50.247180 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 13 10:58:50.247180 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 13 10:58:50.247180 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 13 10:58:50.247180 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 13 10:58:50.247180 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 13 10:58:50.247180 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application Oct 13 10:58:50.247180 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 13 10:58:50.247180 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application Oct 13 10:58:50.247180 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 10:58:50.247180 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 10:58:50.247180 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 10:58:50.247180 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 10:58:50.247180 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 10:58:50.248228 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 10:58:50.248228 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 10:58:50.248228 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 10:58:50.248228 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 10:58:50.248228 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 10:58:50.248228 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 10:58:50.248228 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 13 10:58:50.248228 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 13 10:58:50.248228 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 13 10:58:50.248228 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 13 10:58:50.248228 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 10:58:50.248228 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 10:58:50.248228 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 10:58:50.248228 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 10:58:50.248228 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 10:58:50.248228 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 10:58:50.249739 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 10:58:50.249739 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application with Lock( Oct 13 10:58:50.249739 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 10:58:50.249739 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._enter() Oct 13 10:58:50.249739 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 10:58:50.249739 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 10:58:50.249739 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 10:58:50.249739 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.creator() Oct 13 10:58:50.249739 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 10:58:50.249739 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application created_value = creator( Oct 13 10:58:50.249739 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 13 10:58:50.249739 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 13 10:58:50.249739 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 13 10:58:50.249739 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application Oct 13 10:58:50.249739 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 375/756] 10.222.0.18 () {56 vars in 1111 bytes} [Thu Oct 13 10:58:50 2022] GET /identity/v3/services/compute => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 10:58:50.254204 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb2fc4a-f0aa-45d0-847a-62ec1a35a2b0 None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:50.319032 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:58:50.359952 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb2fc4a-f0aa-45d0-847a-62ec1a35a2b0 None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:50.395318 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55e2a82-2f4e-4030-a90b-639313516738 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:50.395927 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55e2a82-2f4e-4030-a90b-639313516738 None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:50.396199 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55e2a82-2f4e-4030-a90b-639313516738 None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:50.396469 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55e2a82-2f4e-4030-a90b-639313516738 None admin] PATH_INFO: `/v3/services` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:50.397651 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55e2a82-2f4e-4030-a90b-639313516738 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81533) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 10:58:50.397960 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55e2a82-2f4e-4030-a90b-639313516738 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:50.399320 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55e2a82-2f4e-4030-a90b-639313516738 None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:50.404636 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 382/757] 10.222.0.18 () {56 vars in 1112 bytes} [Thu Oct 13 10:58:50 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 10:58:50.410220 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0299e827-4307-45a0-a3d7-8d30349ce044 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:50.511891 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0299e827-4307-45a0-a3d7-8d30349ce044 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:50.538525 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:58:50.546819 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b731e809-0f1b-4ba2-bae8-264fa227aab0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:50.547428 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b731e809-0f1b-4ba2-bae8-264fa227aab0 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:50.547730 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b731e809-0f1b-4ba2-bae8-264fa227aab0 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:50.548000 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b731e809-0f1b-4ba2-bae8-264fa227aab0 None admin] PATH_INFO: `/v3/services` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:50.548630 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b731e809-0f1b-4ba2-bae8-264fa227aab0 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 10:58:50.548927 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b731e809-0f1b-4ba2-bae8-264fa227aab0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:50.550405 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b731e809-0f1b-4ba2-bae8-264fa227aab0 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:50.556231 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 376/758] 10.222.0.18 () {56 vars in 1112 bytes} [Thu Oct 13 10:58:50 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 10:58:50.562179 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55e2a82-2f4e-4030-a90b-639313516738 None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:50.671382 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55e2a82-2f4e-4030-a90b-639313516738 None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:50.697976 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:58:50.706972 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ca131a-22e7-4c22-b561-40c0a8466cea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:50.707790 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ca131a-22e7-4c22-b561-40c0a8466cea None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:50.708069 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ca131a-22e7-4c22-b561-40c0a8466cea None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:50.708336 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ca131a-22e7-4c22-b561-40c0a8466cea None admin] PATH_INFO: `/v3/endpoints` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:50.709118 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ca131a-22e7-4c22-b561-40c0a8466cea None admin] RBAC: Adding query filter params (interface=public, service_id=a85a2e541d334a9ab90f7981de8bd780, region_id=RegionOne) {{(pid=81533) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 10:58:50.709426 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ca131a-22e7-4c22-b561-40c0a8466cea None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:50.710821 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ca131a-22e7-4c22-b561-40c0a8466cea None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:50.716372 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 383/759] 10.222.0.18 () {56 vars in 1251 bytes} [Thu Oct 13 10:58:50 2022] GET /identity/v3/endpoints?service_id=a85a2e541d334a9ab90f7981de8bd780&interface=public®ion_id=RegionOne => generated 194 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 10:58:50.721988 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b731e809-0f1b-4ba2-bae8-264fa227aab0 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:50.738873 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b0b7cd-8912-42a7-b012-8784b2aea556 None None] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:50.739461 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b0b7cd-8912-42a7-b012-8784b2aea556 None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:50.739461 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b0b7cd-8912-42a7-b012-8784b2aea556 None None] PATH_INFO: `/` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:50.742802 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 384/760] 10.222.0.18 () {54 vars in 927 bytes} [Thu Oct 13 10:58:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 10:58:50.748349 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad46f7f6-16cd-4b5e-b48a-e055aaa7d3d1 None None] REQUEST_METHOD: `POST` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:50.748636 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad46f7f6-16cd-4b5e-b48a-e055aaa7d3d1 None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:50.748919 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad46f7f6-16cd-4b5e-b48a-e055aaa7d3d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:50.768319 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.auth.core [None req-ad46f7f6-16cd-4b5e-b48a-e055aaa7d3d1 None None] MFA Rules not processed for user `8ba31ade43694cf8bf28f7528a9ea179`. Rule list: `[]` (Enabled: `True`). {{(pid=81533) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 10:58:50.769600 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-ad46f7f6-16cd-4b5e-b48a-e055aaa7d3d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 10:58:50.841729 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b731e809-0f1b-4ba2-bae8-264fa227aab0 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:50.853157 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 385/761] 10.222.0.18 () {58 vars in 1024 bytes} [Thu Oct 13 10:58:50 2022] POST /identity/v3/auth/tokens => generated 1813 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 13 10:58:50.882652 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a2a208-4311-4cb3-a1fe-edf235c73d1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:50.883341 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a2a208-4311-4cb3-a1fe-edf235c73d1c None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:50.883618 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a2a208-4311-4cb3-a1fe-edf235c73d1c None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:50.883886 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a2a208-4311-4cb3-a1fe-edf235c73d1c None admin] PATH_INFO: `/v3/services` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:50.884693 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a2a208-4311-4cb3-a1fe-edf235c73d1c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:50.886191 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a2a208-4311-4cb3-a1fe-edf235c73d1c None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:50.892984 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 377/762] 10.222.0.18 () {56 vars in 1087 bytes} [Thu Oct 13 10:58:50 2022] GET /identity/v3/services => generated 1957 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 13 10:58:51.088027 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a8aa81-ebaf-4052-bf96-091c94095739 None None] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:51.088365 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a8aa81-ebaf-4052-bf96-091c94095739 None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:51.088537 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a8aa81-ebaf-4052-bf96-091c94095739 None None] PATH_INFO: `/` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:51.090227 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 386/763] 10.222.0.18 () {54 vars in 927 bytes} [Thu Oct 13 10:58:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 10:58:51.095880 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fa18ac-162c-4cbc-9b2a-7c03274f03f6 None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:51.096161 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fa18ac-162c-4cbc-9b2a-7c03274f03f6 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:51.096427 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fa18ac-162c-4cbc-9b2a-7c03274f03f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:51.117277 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-b7fa18ac-162c-4cbc-9b2a-7c03274f03f6 None None] MFA Rules not processed for user `8ba31ade43694cf8bf28f7528a9ea179`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 10:58:51.118881 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-b7fa18ac-162c-4cbc-9b2a-7c03274f03f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 10:58:51.135657 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a8aa81-ebaf-4052-bf96-091c94095739 None None] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:51.177496 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:58:51.205145 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 378/764] 10.222.0.18 () {58 vars in 1024 bytes} [Thu Oct 13 10:58:51 2022] POST /identity/v3/auth/tokens => generated 1813 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 13 10:58:51.256198 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a8aa81-ebaf-4052-bf96-091c94095739 None None] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:51.277110 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:58:51.292033 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64080ec-237a-4a27-b1a5-63de64b5d682 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:51.292635 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64080ec-237a-4a27-b1a5-63de64b5d682 None admin] REQUEST_METHOD: `POST` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:51.292908 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64080ec-237a-4a27-b1a5-63de64b5d682 None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:51.293207 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64080ec-237a-4a27-b1a5-63de64b5d682 None admin] PATH_INFO: `/v3/users` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:51.293860 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64080ec-237a-4a27-b1a5-63de64b5d682 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:51.295276 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64080ec-237a-4a27-b1a5-63de64b5d682 None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:51.312511 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.sql.core [None req-a64080ec-237a-4a27-b1a5-63de64b5d682 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Oct 13 10:58:51.312511 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Oct 13 10:58:51.312511 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: [parameters: {'user_id': '92fd97a3a6104e46989afc132034302d', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Oct 13 10:58:51.312511 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81533) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Oct 13 10:58:51.320302 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application [None req-a64080ec-237a-4a27-b1a5-63de64b5d682 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Oct 13 10:58:51.320302 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 10:58:51.320302 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 13 10:58:51.320302 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 13 10:58:51.320302 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 13 10:58:51.320302 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 13 10:58:51.320302 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 13 10:58:51.320302 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application result = self._query(query) Oct 13 10:58:51.320302 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 13 10:58:51.320302 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application conn.query(q) Oct 13 10:58:51.320302 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 13 10:58:51.320302 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 13 10:58:51.320302 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 13 10:58:51.320302 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application result.read() Oct 13 10:58:51.320302 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 13 10:58:51.321225 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 13 10:58:51.321225 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 13 10:58:51.321225 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 13 10:58:51.321225 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 13 10:58:51.321225 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 13 10:58:51.321225 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 13 10:58:51.321225 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 13 10:58:51.321225 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Oct 13 10:58:51.321225 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application Oct 13 10:58:51.321225 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Oct 13 10:58:51.321225 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application Oct 13 10:58:51.321225 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 10:58:51.321225 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Oct 13 10:58:51.321225 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return method(*args, **kwargs) Oct 13 10:58:51.321225 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Oct 13 10:58:51.321225 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Oct 13 10:58:51.321225 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 13 10:58:51.321225 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application next(self.gen) Oct 13 10:58:51.322331 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Oct 13 10:58:51.322331 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application yield resource Oct 13 10:58:51.322331 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 13 10:58:51.322331 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application next(self.gen) Oct 13 10:58:51.322331 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Oct 13 10:58:51.322331 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application self.session.rollback() Oct 13 10:58:51.322331 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 13 10:58:51.322331 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application self.force_reraise() Oct 13 10:58:51.322331 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 13 10:58:51.322331 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application raise self.value Oct 13 10:58:51.322331 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Oct 13 10:58:51.322331 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Oct 13 10:58:51.322331 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Oct 13 10:58:51.322331 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application session.commit() Oct 13 10:58:51.322331 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Oct 13 10:58:51.322331 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Oct 13 10:58:51.322331 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Oct 13 10:58:51.323849 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application self._prepare_impl() Oct 13 10:58:51.323849 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Oct 13 10:58:51.323849 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application self.session.flush() Oct 13 10:58:51.323849 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 13 10:58:51.323849 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application self._flush(objects) Oct 13 10:58:51.323849 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 13 10:58:51.323849 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Oct 13 10:58:51.323849 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 13 10:58:51.323849 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application compat.raise_( Oct 13 10:58:51.323849 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 13 10:58:51.323849 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application raise exception Oct 13 10:58:51.323849 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 13 10:58:51.323849 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application flush_context.execute() Oct 13 10:58:51.323849 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 13 10:58:51.323849 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application rec.execute(self) Oct 13 10:58:51.323849 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 13 10:58:51.323849 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Oct 13 10:58:51.324982 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 13 10:58:51.324982 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application _emit_insert_statements( Oct 13 10:58:51.324982 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Oct 13 10:58:51.324982 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application result = connection._execute_20( Oct 13 10:58:51.324982 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 13 10:58:51.324982 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Oct 13 10:58:51.324982 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 13 10:58:51.324982 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Oct 13 10:58:51.324982 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 13 10:58:51.324982 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application ret = self._execute_context( Oct 13 10:58:51.324982 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 13 10:58:51.324982 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Oct 13 10:58:51.324982 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 13 10:58:51.324982 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 13 10:58:51.324982 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 13 10:58:51.324982 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application raise exception Oct 13 10:58:51.325873 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 13 10:58:51.325873 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 13 10:58:51.325873 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 13 10:58:51.325873 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 13 10:58:51.325873 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 13 10:58:51.325873 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application result = self._query(query) Oct 13 10:58:51.325873 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 13 10:58:51.325873 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application conn.query(q) Oct 13 10:58:51.325873 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 13 10:58:51.325873 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 13 10:58:51.325873 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 13 10:58:51.325873 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application result.read() Oct 13 10:58:51.325873 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 13 10:58:51.325873 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 13 10:58:51.325873 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 13 10:58:51.325873 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 13 10:58:51.326964 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 13 10:58:51.326964 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 13 10:58:51.326964 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 13 10:58:51.326964 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 13 10:58:51.326964 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Oct 13 10:58:51.326964 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Oct 13 10:58:51.326964 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application [parameters: {'user_id': '92fd97a3a6104e46989afc132034302d', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Oct 13 10:58:51.326964 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 13 10:58:51.326964 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application Oct 13 10:58:51.326964 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 13 10:58:51.326964 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application Oct 13 10:58:51.326964 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 10:58:51.326964 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 10:58:51.326964 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 10:58:51.326964 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 10:58:51.327925 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 10:58:51.327925 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 10:58:51.327925 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 10:58:51.327925 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 10:58:51.327925 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 10:58:51.327925 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 10:58:51.327925 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 10:58:51.327925 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Oct 13 10:58:51.327925 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Oct 13 10:58:51.327925 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 10:58:51.327925 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 10:58:51.327925 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 13 10:58:51.327925 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 13 10:58:51.327925 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 13 10:58:51.327925 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 13 10:58:51.327925 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Oct 13 10:58:51.327925 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Oct 13 10:58:51.328844 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Oct 13 10:58:51.328844 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Oct 13 10:58:51.328844 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Oct 13 10:58:51.328844 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Oct 13 10:58:51.328844 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Oct 13 10:58:51.328844 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application Oct 13 10:58:51.328844 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 387/765] 10.222.0.18 () {60 vars in 1131 bytes} [Thu Oct 13 10:58:51 2022] POST /identity/v3/users => generated 160 bytes in 186 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Oct 13 10:58:51.333244 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7fa18ac-162c-4cbc-9b2a-7c03274f03f6 None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:51.442843 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7fa18ac-162c-4cbc-9b2a-7c03274f03f6 None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:51.478486 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8edaed75-e1cc-40f8-9995-7df86b2fafbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:51.479112 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edaed75-e1cc-40f8-9995-7df86b2fafbf None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:51.479386 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edaed75-e1cc-40f8-9995-7df86b2fafbf None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:51.479654 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edaed75-e1cc-40f8-9995-7df86b2fafbf None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:51.488235 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64080ec-237a-4a27-b1a5-63de64b5d682 None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:51.491160 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8edaed75-e1cc-40f8-9995-7df86b2fafbf None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:51.491160 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8edaed75-e1cc-40f8-9995-7df86b2fafbf None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:51.510984 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application [None req-8edaed75-e1cc-40f8-9995-7df86b2fafbf None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Oct 13 10:58:51.510984 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 10:58:51.510984 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 10:58:51.510984 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 10:58:51.510984 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 10:58:51.510984 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 10:58:51.510984 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 10:58:51.510984 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 10:58:51.510984 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 10:58:51.510984 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 10:58:51.510984 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 10:58:51.510984 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 10:58:51.510984 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 13 10:58:51.510984 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 13 10:58:51.510984 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 13 10:58:51.510984 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 13 10:58:51.511980 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 10:58:51.511980 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 10:58:51.511980 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 13 10:58:51.511980 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 13 10:58:51.511980 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 13 10:58:51.511980 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 13 10:58:51.511980 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 10:58:51.511980 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 10:58:51.511980 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 10:58:51.511980 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 10:58:51.511980 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 10:58:51.511980 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application with Lock( Oct 13 10:58:51.511980 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 10:58:51.511980 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._enter() Oct 13 10:58:51.511980 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 10:58:51.511980 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 10:58:51.511980 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 10:58:51.511980 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.creator() Oct 13 10:58:51.513584 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 10:58:51.513584 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application created_value = creator( Oct 13 10:58:51.513584 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 13 10:58:51.513584 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 13 10:58:51.513584 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 13 10:58:51.513584 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 13 10:58:51.513584 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 13 10:58:51.513584 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 13 10:58:51.513584 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Oct 13 10:58:51.513584 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application Oct 13 10:58:51.513584 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 379/766] 10.222.0.18 () {56 vars in 1099 bytes} [Thu Oct 13 10:58:51 2022] GET /identity/v3/users/cinder => generated 84 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 10:58:51.517845 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8edaed75-e1cc-40f8-9995-7df86b2fafbf None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:51.576694 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:58:51.618136 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64080ec-237a-4a27-b1a5-63de64b5d682 None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:51.629374 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8edaed75-e1cc-40f8-9995-7df86b2fafbf None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:51.661895 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc58b82d-bd6f-4cf0-8480-004e1a183386 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:51.662701 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc58b82d-bd6f-4cf0-8480-004e1a183386 None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:51.663786 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc58b82d-bd6f-4cf0-8480-004e1a183386 None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:51.664077 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc58b82d-bd6f-4cf0-8480-004e1a183386 None admin] PATH_INFO: `/v3/services/image` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:51.664826 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc58b82d-bd6f-4cf0-8480-004e1a183386 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:51.666586 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc58b82d-bd6f-4cf0-8480-004e1a183386 None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:51.669300 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cffa047b-e14d-40c3-9444-e56ba6ae7bb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:51.670151 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffa047b-e14d-40c3-9444-e56ba6ae7bb0 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:51.670646 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffa047b-e14d-40c3-9444-e56ba6ae7bb0 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:51.671114 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffa047b-e14d-40c3-9444-e56ba6ae7bb0 None admin] PATH_INFO: `/v3/users` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:51.672010 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cffa047b-e14d-40c3-9444-e56ba6ae7bb0 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=81534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 10:58:51.672514 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cffa047b-e14d-40c3-9444-e56ba6ae7bb0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:51.674155 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cffa047b-e14d-40c3-9444-e56ba6ae7bb0 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:51.675738 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application [None req-fc58b82d-bd6f-4cf0-8480-004e1a183386 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Oct 13 10:58:51.675738 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 10:58:51.675738 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 13 10:58:51.675738 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 13 10:58:51.675738 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 13 10:58:51.675738 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 13 10:58:51.675738 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 13 10:58:51.675738 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 13 10:58:51.675738 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 13 10:58:51.675738 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application Oct 13 10:58:51.675738 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 13 10:58:51.675738 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application Oct 13 10:58:51.675738 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 10:58:51.675738 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 10:58:51.675738 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 10:58:51.675738 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 10:58:51.675738 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 10:58:51.682132 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 10:58:51.682132 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 10:58:51.682132 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 10:58:51.682132 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 10:58:51.682132 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 10:58:51.682132 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 10:58:51.682132 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 13 10:58:51.682132 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 13 10:58:51.682132 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 13 10:58:51.682132 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 13 10:58:51.682132 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 10:58:51.682132 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 10:58:51.682132 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 10:58:51.682132 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 10:58:51.682132 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 10:58:51.682132 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 10:58:51.683060 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 10:58:51.683060 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application with Lock( Oct 13 10:58:51.683060 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 10:58:51.683060 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._enter() Oct 13 10:58:51.683060 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 10:58:51.683060 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 10:58:51.683060 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 10:58:51.683060 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.creator() Oct 13 10:58:51.683060 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 10:58:51.683060 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application created_value = creator( Oct 13 10:58:51.683060 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 13 10:58:51.683060 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 13 10:58:51.683060 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 13 10:58:51.683060 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application Oct 13 10:58:51.683060 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 388/767] 10.222.0.18 () {56 vars in 1105 bytes} [Thu Oct 13 10:58:51 2022] GET /identity/v3/services/image => generated 86 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 13 10:58:51.686219 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc58b82d-bd6f-4cf0-8480-004e1a183386 None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:51.728968 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 380/768] 10.222.0.18 () {56 vars in 1101 bytes} [Thu Oct 13 10:58:51 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 13 10:58:51.746581 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:58:51.815422 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc58b82d-bd6f-4cf0-8480-004e1a183386 None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:51.855964 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997facb5-20a0-4ae4-bdfc-906fe737be56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:51.857085 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997facb5-20a0-4ae4-bdfc-906fe737be56 None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:51.857574 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997facb5-20a0-4ae4-bdfc-906fe737be56 None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:51.858065 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997facb5-20a0-4ae4-bdfc-906fe737be56 None admin] PATH_INFO: `/v3/services` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:51.858917 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997facb5-20a0-4ae4-bdfc-906fe737be56 None admin] RBAC: Adding query filter params (name=image) {{(pid=81533) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 10:58:51.859422 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997facb5-20a0-4ae4-bdfc-906fe737be56 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:51.861126 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997facb5-20a0-4ae4-bdfc-906fe737be56 None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:51.874946 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 389/769] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Oct 13 10:58:51 2022] GET /identity/v3/services?name=image => generated 122 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 13 10:58:51.876739 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cffa047b-e14d-40c3-9444-e56ba6ae7bb0 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:51.984974 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cffa047b-e14d-40c3-9444-e56ba6ae7bb0 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:51.988127 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:58:52.024262 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584859da-58bf-401a-abed-fe916253304b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:52.024899 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584859da-58bf-401a-abed-fe916253304b None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:52.025204 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584859da-58bf-401a-abed-fe916253304b None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:52.025483 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584859da-58bf-401a-abed-fe916253304b None admin] PATH_INFO: `/v3/services` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:52.026196 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584859da-58bf-401a-abed-fe916253304b None admin] RBAC: Adding query filter params (type=image) {{(pid=81534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 10:58:52.026518 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584859da-58bf-401a-abed-fe916253304b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:52.028065 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584859da-58bf-401a-abed-fe916253304b None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:52.039453 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 381/770] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Oct 13 10:58:51 2022] GET /identity/v3/services?type=image => generated 350 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 10:58:52.041275 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997facb5-20a0-4ae4-bdfc-906fe737be56 None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:52.148046 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997facb5-20a0-4ae4-bdfc-906fe737be56 None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:52.157525 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767d48eb-06f4-4f28-8cdc-d4d22f401c97 None None] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:52.157811 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767d48eb-06f4-4f28-8cdc-d4d22f401c97 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:52.158070 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767d48eb-06f4-4f28-8cdc-d4d22f401c97 None None] PATH_INFO: `/` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:52.158802 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:58:52.159637 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 382/771] 10.222.0.18 () {54 vars in 927 bytes} [Thu Oct 13 10:58:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 13 10:58:52.165168 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c05a91a-f927-40a5-bed4-16a29bb615da None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:52.165448 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c05a91a-f927-40a5-bed4-16a29bb615da None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:52.165713 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c05a91a-f927-40a5-bed4-16a29bb615da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:52.185503 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159e068e-2687-4bf9-b1eb-3625d7d14444 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:52.186132 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159e068e-2687-4bf9-b1eb-3625d7d14444 None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:52.186411 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159e068e-2687-4bf9-b1eb-3625d7d14444 None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:52.186683 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159e068e-2687-4bf9-b1eb-3625d7d14444 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:52.187481 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159e068e-2687-4bf9-b1eb-3625d7d14444 None admin] RBAC: Adding query filter params (interface=public, service_id=a7d4696e5a9e4bca842bcbe7ea60d6e2, region_id=RegionOne) {{(pid=81533) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 10:58:52.187797 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159e068e-2687-4bf9-b1eb-3625d7d14444 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:52.189207 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159e068e-2687-4bf9-b1eb-3625d7d14444 None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:52.195752 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 390/772] 10.222.0.18 () {56 vars in 1251 bytes} [Thu Oct 13 10:58:52 2022] GET /identity/v3/endpoints?service_id=a7d4696e5a9e4bca842bcbe7ea60d6e2&interface=public®ion_id=RegionOne => generated 194 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 10:58:52.201697 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159e068e-2687-4bf9-b1eb-3625d7d14444 None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:52.322187 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-7c05a91a-f927-40a5-bed4-16a29bb615da None None] MFA Rules not processed for user `8ba31ade43694cf8bf28f7528a9ea179`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 10:58:52.323313 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-7c05a91a-f927-40a5-bed4-16a29bb615da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 10:58:52.394974 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 383/773] 10.222.0.18 () {58 vars in 1024 bytes} [Thu Oct 13 10:58:52 2022] POST /identity/v3/auth/tokens => generated 1813 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 13 10:58:52.425535 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159e068e-2687-4bf9-b1eb-3625d7d14444 None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:52.460430 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f0de6b-ac25-430d-834b-72cfd3f34ed5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:52.461052 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f0de6b-ac25-430d-834b-72cfd3f34ed5 None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:52.461334 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f0de6b-ac25-430d-834b-72cfd3f34ed5 None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:52.461605 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f0de6b-ac25-430d-834b-72cfd3f34ed5 None admin] PATH_INFO: `/v3/services` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:52.462231 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f0de6b-ac25-430d-834b-72cfd3f34ed5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:52.463584 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f0de6b-ac25-430d-834b-72cfd3f34ed5 None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:52.470256 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 391/774] 10.222.0.18 () {56 vars in 1087 bytes} [Thu Oct 13 10:58:52 2022] GET /identity/v3/services => generated 1957 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 13 10:58:52.669028 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c05a91a-f927-40a5-bed4-16a29bb615da None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:52.772908 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:58:52.776867 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c05a91a-f927-40a5-bed4-16a29bb615da None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:52.811894 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbcc4eb-e23d-441b-b160-d259aba9dcea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:52.812514 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbcc4eb-e23d-441b-b160-d259aba9dcea None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:52.812789 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbcc4eb-e23d-441b-b160-d259aba9dcea None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:52.813082 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbcc4eb-e23d-441b-b160-d259aba9dcea None admin] PATH_INFO: `/v3/domains/default` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:52.814171 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cbcc4eb-e23d-441b-b160-d259aba9dcea None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:52.815607 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cbcc4eb-e23d-441b-b160-d259aba9dcea None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:52.817337 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 384/775] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Oct 13 10:58:52 2022] GET /identity/v3/domains/default => generated 199 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 10:58:52.823345 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f0de6b-ac25-430d-834b-72cfd3f34ed5 None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:52.864359 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:58:52.925302 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f0de6b-ac25-430d-834b-72cfd3f34ed5 None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:52.961488 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8670acf-ad04-4034-b14b-2a22e3ad7145 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:52.962094 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8670acf-ad04-4034-b14b-2a22e3ad7145 None admin] REQUEST_METHOD: `POST` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:52.962367 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8670acf-ad04-4034-b14b-2a22e3ad7145 None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:52.962632 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8670acf-ad04-4034-b14b-2a22e3ad7145 None admin] PATH_INFO: `/v3/projects` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:52.963288 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8670acf-ad04-4034-b14b-2a22e3ad7145 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:52.964691 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8670acf-ad04-4034-b14b-2a22e3ad7145 None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:52.996542 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 392/776] 10.222.0.18 () {60 vars in 1141 bytes} [Thu Oct 13 10:58:52 2022] POST /identity/v3/projects => generated 311 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 13 10:58:53.133444 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a741c86-454a-4ff7-b069-78414702794f None None] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:53.133798 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a741c86-454a-4ff7-b069-78414702794f None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:53.133997 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a741c86-454a-4ff7-b069-78414702794f None None] PATH_INFO: `/` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:53.135578 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 385/777] 10.222.0.18 () {54 vars in 927 bytes} [Thu Oct 13 10:58:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 10:58:53.141532 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe494cbf-481f-4ec7-b218-509a40ebb145 None None] REQUEST_METHOD: `POST` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:53.141820 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe494cbf-481f-4ec7-b218-509a40ebb145 None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:53.142094 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe494cbf-481f-4ec7-b218-509a40ebb145 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:53.161745 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.auth.core [None req-fe494cbf-481f-4ec7-b218-509a40ebb145 None None] MFA Rules not processed for user `8ba31ade43694cf8bf28f7528a9ea179`. Rule list: `[]` (Enabled: `True`). {{(pid=81533) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 10:58:53.163988 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-fe494cbf-481f-4ec7-b218-509a40ebb145 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 10:58:53.234831 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 393/778] 10.222.0.18 () {58 vars in 1024 bytes} [Thu Oct 13 10:58:53 2022] POST /identity/v3/auth/tokens => generated 1813 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 13 10:58:53.507548 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a741c86-454a-4ff7-b069-78414702794f None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:53.610411 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a741c86-454a-4ff7-b069-78414702794f None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:53.644416 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd7a723-2a83-4537-ac4c-f3e51ccba3ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:53.645054 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd7a723-2a83-4537-ac4c-f3e51ccba3ce None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:53.645335 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd7a723-2a83-4537-ac4c-f3e51ccba3ce None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:53.645601 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd7a723-2a83-4537-ac4c-f3e51ccba3ce None admin] PATH_INFO: `/v3/services/compute` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:53.646176 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd7a723-2a83-4537-ac4c-f3e51ccba3ce None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:53.647583 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd7a723-2a83-4537-ac4c-f3e51ccba3ce None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:53.656332 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application [None req-fbd7a723-2a83-4537-ac4c-f3e51ccba3ce None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Oct 13 10:58:53.656332 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 10:58:53.656332 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 13 10:58:53.656332 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 13 10:58:53.656332 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 13 10:58:53.656332 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 13 10:58:53.656332 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 13 10:58:53.656332 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 13 10:58:53.656332 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 13 10:58:53.656332 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application Oct 13 10:58:53.656332 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 13 10:58:53.656332 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application Oct 13 10:58:53.656332 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 10:58:53.656332 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 10:58:53.656332 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 10:58:53.656332 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 10:58:53.656332 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 10:58:53.657325 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 10:58:53.657325 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 10:58:53.657325 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 10:58:53.657325 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 10:58:53.657325 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 10:58:53.657325 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 10:58:53.657325 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 13 10:58:53.657325 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 13 10:58:53.657325 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 13 10:58:53.657325 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 13 10:58:53.657325 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 10:58:53.657325 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 10:58:53.657325 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 10:58:53.657325 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 10:58:53.657325 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 10:58:53.657325 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 10:58:53.658199 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 10:58:53.658199 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application with Lock( Oct 13 10:58:53.658199 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 10:58:53.658199 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._enter() Oct 13 10:58:53.658199 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 10:58:53.658199 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 10:58:53.658199 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 10:58:53.658199 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.creator() Oct 13 10:58:53.658199 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 10:58:53.658199 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application created_value = creator( Oct 13 10:58:53.658199 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 13 10:58:53.658199 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 13 10:58:53.658199 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 13 10:58:53.658199 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application Oct 13 10:58:53.661149 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 386/779] 10.222.0.18 () {56 vars in 1111 bytes} [Thu Oct 13 10:58:53 2022] GET /identity/v3/services/compute => generated 88 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 10:58:53.664003 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe494cbf-481f-4ec7-b218-509a40ebb145 None None] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:53.686414 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:58:53.773774 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe494cbf-481f-4ec7-b218-509a40ebb145 None None] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:53.809479 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065ffa93-e012-4bb0-8a6c-d62241120d02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:53.810079 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065ffa93-e012-4bb0-8a6c-d62241120d02 None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:53.810348 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065ffa93-e012-4bb0-8a6c-d62241120d02 None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:53.810610 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065ffa93-e012-4bb0-8a6c-d62241120d02 None admin] PATH_INFO: `/v3/services` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:53.811253 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065ffa93-e012-4bb0-8a6c-d62241120d02 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81533) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 10:58:53.811548 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065ffa93-e012-4bb0-8a6c-d62241120d02 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:53.812883 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065ffa93-e012-4bb0-8a6c-d62241120d02 None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:53.817919 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 394/780] 10.222.0.18 () {56 vars in 1112 bytes} [Thu Oct 13 10:58:53 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 13 10:58:53.823568 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd7a723-2a83-4537-ac4c-f3e51ccba3ce None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:53.855948 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:58:53.927494 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd7a723-2a83-4537-ac4c-f3e51ccba3ce None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:53.963512 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4973a5bb-1d27-4024-b7f8-e362830f8042 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:53.964114 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4973a5bb-1d27-4024-b7f8-e362830f8042 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:53.964388 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4973a5bb-1d27-4024-b7f8-e362830f8042 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:53.964653 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4973a5bb-1d27-4024-b7f8-e362830f8042 None admin] PATH_INFO: `/v3/services` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:53.965294 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4973a5bb-1d27-4024-b7f8-e362830f8042 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 10:58:53.965590 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4973a5bb-1d27-4024-b7f8-e362830f8042 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:53.966927 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4973a5bb-1d27-4024-b7f8-e362830f8042 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:53.971772 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 387/781] 10.222.0.18 () {56 vars in 1112 bytes} [Thu Oct 13 10:58:53 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 13 10:58:53.977475 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065ffa93-e012-4bb0-8a6c-d62241120d02 None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:54.063839 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:58:54.080169 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065ffa93-e012-4bb0-8a6c-d62241120d02 None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:54.113149 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782cf6f1-5cf7-4915-aaec-47aa50400363 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:54.113743 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782cf6f1-5cf7-4915-aaec-47aa50400363 None admin] REQUEST_METHOD: `POST` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:54.114011 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782cf6f1-5cf7-4915-aaec-47aa50400363 None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:54.114271 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782cf6f1-5cf7-4915-aaec-47aa50400363 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:54.114928 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782cf6f1-5cf7-4915-aaec-47aa50400363 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:54.116959 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782cf6f1-5cf7-4915-aaec-47aa50400363 None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:54.144786 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 395/782] 10.222.0.18 () {60 vars in 1144 bytes} [Thu Oct 13 10:58:53 2022] POST /identity/v3/endpoints => generated 334 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 13 10:58:54.662834 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627dd428-a2bd-41bc-9b3a-572cf31c596c None None] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:54.663246 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627dd428-a2bd-41bc-9b3a-572cf31c596c None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:54.663434 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627dd428-a2bd-41bc-9b3a-572cf31c596c None None] PATH_INFO: `/` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:54.664873 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 388/783] 10.222.0.18 () {54 vars in 927 bytes} [Thu Oct 13 10:58:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 10:58:54.670055 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ba4a2b-6a22-4818-9c0c-c56f4f90c573 None None] REQUEST_METHOD: `POST` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:54.670345 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ba4a2b-6a22-4818-9c0c-c56f4f90c573 None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:54.670614 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ba4a2b-6a22-4818-9c0c-c56f4f90c573 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:54.690151 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.auth.core [None req-b1ba4a2b-6a22-4818-9c0c-c56f4f90c573 None None] MFA Rules not processed for user `8ba31ade43694cf8bf28f7528a9ea179`. Rule list: `[]` (Enabled: `True`). {{(pid=81533) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 10:58:54.691343 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-b1ba4a2b-6a22-4818-9c0c-c56f4f90c573 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 10:58:54.768981 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 396/784] 10.222.0.18 () {58 vars in 1024 bytes} [Thu Oct 13 10:58:54 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 13 10:58:55.039432 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627dd428-a2bd-41bc-9b3a-572cf31c596c None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:55.141554 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:58:55.150150 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627dd428-a2bd-41bc-9b3a-572cf31c596c None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:55.183964 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080a07ef-fdfa-45db-a8b7-f0f843216bc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:55.184585 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080a07ef-fdfa-45db-a8b7-f0f843216bc3 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:55.184856 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080a07ef-fdfa-45db-a8b7-f0f843216bc3 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:55.185153 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080a07ef-fdfa-45db-a8b7-f0f843216bc3 None admin] PATH_INFO: `/v3/services/image` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:55.185722 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080a07ef-fdfa-45db-a8b7-f0f843216bc3 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:55.187063 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080a07ef-fdfa-45db-a8b7-f0f843216bc3 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:55.195772 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application [None req-080a07ef-fdfa-45db-a8b7-f0f843216bc3 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Oct 13 10:58:55.195772 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 10:58:55.195772 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 13 10:58:55.195772 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 13 10:58:55.195772 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 13 10:58:55.195772 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 13 10:58:55.195772 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 13 10:58:55.195772 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 13 10:58:55.195772 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 13 10:58:55.195772 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application Oct 13 10:58:55.195772 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 13 10:58:55.195772 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application Oct 13 10:58:55.195772 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 10:58:55.195772 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 10:58:55.195772 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 10:58:55.195772 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 10:58:55.195772 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 10:58:55.196848 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 10:58:55.196848 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 10:58:55.196848 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 10:58:55.196848 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 10:58:55.196848 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 10:58:55.196848 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 10:58:55.196848 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 13 10:58:55.196848 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 13 10:58:55.196848 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 13 10:58:55.196848 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 13 10:58:55.196848 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 10:58:55.196848 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 10:58:55.196848 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 10:58:55.196848 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 10:58:55.196848 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 10:58:55.196848 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 10:58:55.202146 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 10:58:55.202146 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application with Lock( Oct 13 10:58:55.202146 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 10:58:55.202146 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._enter() Oct 13 10:58:55.202146 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 10:58:55.202146 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 10:58:55.202146 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 10:58:55.202146 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.creator() Oct 13 10:58:55.202146 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 10:58:55.202146 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application created_value = creator( Oct 13 10:58:55.202146 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 13 10:58:55.202146 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 13 10:58:55.202146 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 13 10:58:55.202146 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application Oct 13 10:58:55.202146 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 389/785] 10.222.0.18 () {56 vars in 1105 bytes} [Thu Oct 13 10:58:55 2022] GET /identity/v3/services/image => generated 86 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 10:58:55.202944 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ba4a2b-6a22-4818-9c0c-c56f4f90c573 None None] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:55.223228 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc4ea85-644e-4a50-af96-64b4a17b09f2 None None] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:55.223708 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc4ea85-644e-4a50-af96-64b4a17b09f2 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:55.224123 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc4ea85-644e-4a50-af96-64b4a17b09f2 None None] PATH_INFO: `/` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:55.227393 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 390/786] 10.222.0.18 () {54 vars in 927 bytes} [Thu Oct 13 10:58:55 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 13 10:58:55.232892 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6ee8c2-cff1-4899-bb59-950d4b743462 None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:55.233339 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6ee8c2-cff1-4899-bb59-950d4b743462 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:55.234014 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6ee8c2-cff1-4899-bb59-950d4b743462 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:55.256970 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-fd6ee8c2-cff1-4899-bb59-950d4b743462 None None] MFA Rules not processed for user `8ba31ade43694cf8bf28f7528a9ea179`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 10:58:55.258255 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-fd6ee8c2-cff1-4899-bb59-950d4b743462 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 10:58:55.273466 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:58:55.313734 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ba4a2b-6a22-4818-9c0c-c56f4f90c573 None None] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:55.330936 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 391/787] 10.222.0.18 () {58 vars in 1024 bytes} [Thu Oct 13 10:58:55 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 13 10:58:55.351031 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17027f8-c68e-4852-8ad2-8bbc68535ab2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:55.351721 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17027f8-c68e-4852-8ad2-8bbc68535ab2 None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:55.352005 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17027f8-c68e-4852-8ad2-8bbc68535ab2 None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:55.352279 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17027f8-c68e-4852-8ad2-8bbc68535ab2 None admin] PATH_INFO: `/v3/services` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:55.352908 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17027f8-c68e-4852-8ad2-8bbc68535ab2 None admin] RBAC: Adding query filter params (name=image) {{(pid=81533) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 10:58:55.353241 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17027f8-c68e-4852-8ad2-8bbc68535ab2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:55.354600 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17027f8-c68e-4852-8ad2-8bbc68535ab2 None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:55.359683 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 397/788] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Oct 13 10:58:55 2022] GET /identity/v3/services?name=image => generated 122 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 10:58:55.365205 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6ee8c2-cff1-4899-bb59-950d4b743462 None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:55.453644 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:58:55.466912 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6ee8c2-cff1-4899-bb59-950d4b743462 None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:55.500827 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf192f7e-aeee-4b32-b7c0-53530246889b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:55.501471 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf192f7e-aeee-4b32-b7c0-53530246889b None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:55.501743 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf192f7e-aeee-4b32-b7c0-53530246889b None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:55.502005 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf192f7e-aeee-4b32-b7c0-53530246889b None admin] PATH_INFO: `/v3/services` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:55.502623 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf192f7e-aeee-4b32-b7c0-53530246889b None admin] RBAC: Adding query filter params (type=image) {{(pid=81534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 10:58:55.502916 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf192f7e-aeee-4b32-b7c0-53530246889b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:55.504258 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf192f7e-aeee-4b32-b7c0-53530246889b None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:55.509702 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 392/789] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Oct 13 10:58:55 2022] GET /identity/v3/services?type=image => generated 350 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 13 10:58:55.515139 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17027f8-c68e-4852-8ad2-8bbc68535ab2 None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:55.604767 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf192f7e-aeee-4b32-b7c0-53530246889b None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:55.611706 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17027f8-c68e-4852-8ad2-8bbc68535ab2 None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:55.640007 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:58:55.646330 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d8fb41-cc3a-4443-89b6-e57a926c3727 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:55.646958 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d8fb41-cc3a-4443-89b6-e57a926c3727 None admin] REQUEST_METHOD: `POST` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:55.647268 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d8fb41-cc3a-4443-89b6-e57a926c3727 None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:55.647532 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d8fb41-cc3a-4443-89b6-e57a926c3727 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:55.648198 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d8fb41-cc3a-4443-89b6-e57a926c3727 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:55.649575 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d8fb41-cc3a-4443-89b6-e57a926c3727 None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:55.669273 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 398/790] 10.222.0.18 () {60 vars in 1144 bytes} [Thu Oct 13 10:58:55 2022] POST /identity/v3/endpoints => generated 327 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 13 10:58:55.719959 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf192f7e-aeee-4b32-b7c0-53530246889b None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:55.770308 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc361d7b-7314-4541-b53a-cbb045ae7bf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:55.770952 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc361d7b-7314-4541-b53a-cbb045ae7bf4 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:55.771252 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc361d7b-7314-4541-b53a-cbb045ae7bf4 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:55.771526 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc361d7b-7314-4541-b53a-cbb045ae7bf4 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:55.772693 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc361d7b-7314-4541-b53a-cbb045ae7bf4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:55.774348 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc361d7b-7314-4541-b53a-cbb045ae7bf4 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:55.776142 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 393/791] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Oct 13 10:58:55 2022] GET /identity/v3/domains/default => generated 199 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 13 10:58:55.781909 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d8fb41-cc3a-4443-89b6-e57a926c3727 None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:55.893841 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d8fb41-cc3a-4443-89b6-e57a926c3727 None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:55.928738 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286bcae1-7f07-47a4-a4e8-b6a6ad8172a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:55.929522 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286bcae1-7f07-47a4-a4e8-b6a6ad8172a6 None admin] REQUEST_METHOD: `POST` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:55.929804 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286bcae1-7f07-47a4-a4e8-b6a6ad8172a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:55.930079 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286bcae1-7f07-47a4-a4e8-b6a6ad8172a6 None admin] PATH_INFO: `/v3/users` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:55.930746 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286bcae1-7f07-47a4-a4e8-b6a6ad8172a6 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:55.932181 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286bcae1-7f07-47a4-a4e8-b6a6ad8172a6 None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:55.956456 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 399/792] 10.222.0.18 () {60 vars in 1132 bytes} [Thu Oct 13 10:58:55 2022] POST /identity/v3/users => generated 285 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 13 10:58:56.373297 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df80fbe4-1da9-4d8d-bd36-60f2db3ccc5e None None] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:56.373921 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df80fbe4-1da9-4d8d-bd36-60f2db3ccc5e None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:56.373921 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df80fbe4-1da9-4d8d-bd36-60f2db3ccc5e None None] PATH_INFO: `/` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:56.375156 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 394/793] 10.222.0.18 () {54 vars in 927 bytes} [Thu Oct 13 10:58:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 10:58:56.380442 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db89f098-d29e-424e-9223-07779e929ef9 None None] REQUEST_METHOD: `POST` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:56.380852 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db89f098-d29e-424e-9223-07779e929ef9 None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:56.381074 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db89f098-d29e-424e-9223-07779e929ef9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:56.399887 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.auth.core [None req-db89f098-d29e-424e-9223-07779e929ef9 None None] MFA Rules not processed for user `8ba31ade43694cf8bf28f7528a9ea179`. Rule list: `[]` (Enabled: `True`). {{(pid=81533) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 10:58:56.401104 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-db89f098-d29e-424e-9223-07779e929ef9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 10:58:56.438478 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:58:56.474574 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 400/794] 10.222.0.18 () {58 vars in 1024 bytes} [Thu Oct 13 10:58:56 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 13 10:58:56.740008 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df80fbe4-1da9-4d8d-bd36-60f2db3ccc5e None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:56.758235 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:58:56.846202 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df80fbe4-1da9-4d8d-bd36-60f2db3ccc5e None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:56.881637 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b89ecd-d5ae-42a1-8ac8-2cb567abb019 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:56.882894 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b89ecd-d5ae-42a1-8ac8-2cb567abb019 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:56.883175 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b89ecd-d5ae-42a1-8ac8-2cb567abb019 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:56.883443 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b89ecd-d5ae-42a1-8ac8-2cb567abb019 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:56.894209 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b89ecd-d5ae-42a1-8ac8-2cb567abb019 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 13 10:58:56.899931 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application [None req-87b89ecd-d5ae-42a1-8ac8-2cb567abb019 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 13 10:58:56.899931 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 10:58:56.899931 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 10:58:56.899931 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 10:58:56.899931 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 10:58:56.899931 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 10:58:56.899931 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 10:58:56.899931 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 10:58:56.899931 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 10:58:56.899931 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 10:58:56.899931 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 10:58:56.899931 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 10:58:56.899931 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 13 10:58:56.899931 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 13 10:58:56.899931 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 13 10:58:56.899931 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 13 10:58:56.900919 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 13 10:58:56.900919 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 13 10:58:56.900919 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 13 10:58:56.900919 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 13 10:58:56.900919 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 10:58:56.900919 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 10:58:56.900919 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 10:58:56.900919 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 10:58:56.900919 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 10:58:56.900919 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 10:58:56.900919 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 10:58:56.900919 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application with Lock( Oct 13 10:58:56.900919 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 10:58:56.900919 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._enter() Oct 13 10:58:56.900919 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 10:58:56.900919 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 10:58:56.906488 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 10:58:56.906488 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.creator() Oct 13 10:58:56.906488 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 10:58:56.906488 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application created_value = creator( Oct 13 10:58:56.906488 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 13 10:58:56.906488 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 13 10:58:56.906488 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 13 10:58:56.906488 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 13 10:58:56.906488 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 13 10:58:56.906488 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 13 10:58:56.906488 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 13 10:58:56.906488 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application Oct 13 10:58:56.906488 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 395/795] 10.222.0.18 () {56 vars in 1120 bytes} [Thu Oct 13 10:58:56 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 10:58:56.907264 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db89f098-d29e-424e-9223-07779e929ef9 None None] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:57.006516 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db89f098-d29e-424e-9223-07779e929ef9 None None] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:57.040214 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc8ca31-47d2-4f9b-9251-79a517238354 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:57.040810 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc8ca31-47d2-4f9b-9251-79a517238354 None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:57.041110 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc8ca31-47d2-4f9b-9251-79a517238354 None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:57.041380 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc8ca31-47d2-4f9b-9251-79a517238354 None admin] PATH_INFO: `/v3/roles` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:57.042034 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc8ca31-47d2-4f9b-9251-79a517238354 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81533) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 10:58:57.042329 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc8ca31-47d2-4f9b-9251-79a517238354 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:57.043675 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc8ca31-47d2-4f9b-9251-79a517238354 None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:57.051624 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 401/796] 10.222.0.18 () {56 vars in 1115 bytes} [Thu Oct 13 10:58:56 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 10:58:57.057639 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b89ecd-d5ae-42a1-8ac8-2cb567abb019 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:57.136907 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:58:57.160360 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b89ecd-d5ae-42a1-8ac8-2cb567abb019 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:57.195394 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c03bc5-6c77-49ec-8ed4-42f7df57a25b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:57.196012 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c03bc5-6c77-49ec-8ed4-42f7df57a25b None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:57.196292 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c03bc5-6c77-49ec-8ed4-42f7df57a25b None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:57.196561 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c03bc5-6c77-49ec-8ed4-42f7df57a25b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:57.206496 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c03bc5-6c77-49ec-8ed4-42f7df57a25b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:57.207922 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c03bc5-6c77-49ec-8ed4-42f7df57a25b None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:57.222295 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application [None req-02c03bc5-6c77-49ec-8ed4-42f7df57a25b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 13 10:58:57.222295 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 10:58:57.222295 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 10:58:57.222295 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 10:58:57.222295 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 10:58:57.222295 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 10:58:57.222295 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 10:58:57.222295 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 10:58:57.222295 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 10:58:57.222295 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 10:58:57.222295 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 10:58:57.222295 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 10:58:57.222295 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 13 10:58:57.222295 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 13 10:58:57.222295 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 13 10:58:57.222295 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 13 10:58:57.223294 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 10:58:57.223294 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 10:58:57.223294 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 10:58:57.223294 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 10:58:57.223294 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 10:58:57.223294 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 10:58:57.223294 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 10:58:57.223294 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application with Lock( Oct 13 10:58:57.223294 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 10:58:57.223294 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._enter() Oct 13 10:58:57.223294 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 10:58:57.223294 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 10:58:57.223294 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 10:58:57.223294 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.creator() Oct 13 10:58:57.223294 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 10:58:57.223294 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application created_value = creator( Oct 13 10:58:57.223294 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 13 10:58:57.224282 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 13 10:58:57.224282 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 13 10:58:57.224282 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application Oct 13 10:58:57.224282 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 396/797] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Oct 13 10:58:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 10:58:57.230961 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc8ca31-47d2-4f9b-9251-79a517238354 None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:57.266237 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:58:57.333166 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc8ca31-47d2-4f9b-9251-79a517238354 None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:57.367379 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89234bc4-e414-4583-96eb-a4a8034091ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:57.367978 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89234bc4-e414-4583-96eb-a4a8034091ee None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:57.368254 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89234bc4-e414-4583-96eb-a4a8034091ee None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:57.368525 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89234bc4-e414-4583-96eb-a4a8034091ee None admin] PATH_INFO: `/v3/domains` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:57.369189 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89234bc4-e414-4583-96eb-a4a8034091ee None admin] RBAC: Adding query filter params (name=Default) {{(pid=81533) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 10:58:57.369490 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89234bc4-e414-4583-96eb-a4a8034091ee None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:57.370844 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89234bc4-e414-4583-96eb-a4a8034091ee None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:57.382753 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 402/798] 10.222.0.18 () {56 vars in 1109 bytes} [Thu Oct 13 10:58:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 13 10:58:57.388336 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c03bc5-6c77-49ec-8ed4-42f7df57a25b None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:57.488736 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c03bc5-6c77-49ec-8ed4-42f7df57a25b None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:57.515375 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:58:57.524359 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2306c9-53fe-42aa-b8f4-830f1bef5c2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:57.524925 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2306c9-53fe-42aa-b8f4-830f1bef5c2e None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:57.525230 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2306c9-53fe-42aa-b8f4-830f1bef5c2e None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:57.525502 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2306c9-53fe-42aa-b8f4-830f1bef5c2e None admin] PATH_INFO: `/v3/users/nova` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:57.532840 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2306c9-53fe-42aa-b8f4-830f1bef5c2e None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:57.534296 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2306c9-53fe-42aa-b8f4-830f1bef5c2e None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:57.545730 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application [None req-0b2306c9-53fe-42aa-b8f4-830f1bef5c2e None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 13 10:58:57.545730 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 10:58:57.545730 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 10:58:57.545730 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 10:58:57.545730 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 10:58:57.545730 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 10:58:57.545730 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 10:58:57.545730 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 10:58:57.545730 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 10:58:57.545730 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 10:58:57.545730 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 10:58:57.545730 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 10:58:57.545730 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 13 10:58:57.545730 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 13 10:58:57.545730 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 13 10:58:57.545730 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 13 10:58:57.546687 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 10:58:57.546687 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 10:58:57.546687 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 13 10:58:57.546687 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 13 10:58:57.546687 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 13 10:58:57.546687 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 13 10:58:57.546687 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 10:58:57.546687 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 10:58:57.546687 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 10:58:57.546687 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 10:58:57.546687 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 10:58:57.546687 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application with Lock( Oct 13 10:58:57.546687 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 10:58:57.546687 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._enter() Oct 13 10:58:57.546687 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 10:58:57.546687 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 10:58:57.546687 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 10:58:57.546687 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.creator() Oct 13 10:58:57.547639 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 10:58:57.547639 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application created_value = creator( Oct 13 10:58:57.547639 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 13 10:58:57.547639 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 13 10:58:57.547639 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 13 10:58:57.547639 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 13 10:58:57.547639 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 13 10:58:57.547639 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 13 10:58:57.547639 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 13 10:58:57.547639 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application Oct 13 10:58:57.549334 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 397/799] 10.222.0.18 () {56 vars in 1093 bytes} [Thu Oct 13 10:58:57 2022] GET /identity/v3/users/nova => generated 82 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 10:58:57.552763 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89234bc4-e414-4583-96eb-a4a8034091ee None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:57.646542 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:58:57.654976 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89234bc4-e414-4583-96eb-a4a8034091ee None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:57.688772 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e5616f-ef0c-45b9-b450-4373a5ea9868 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:57.689408 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e5616f-ef0c-45b9-b450-4373a5ea9868 None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:57.689688 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e5616f-ef0c-45b9-b450-4373a5ea9868 None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:57.689958 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e5616f-ef0c-45b9-b450-4373a5ea9868 None admin] PATH_INFO: `/v3/users` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:57.690680 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e5616f-ef0c-45b9-b450-4373a5ea9868 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81533) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 10:58:57.690985 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e5616f-ef0c-45b9-b450-4373a5ea9868 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:57.692399 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e5616f-ef0c-45b9-b450-4373a5ea9868 None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:57.710827 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 403/800] 10.222.0.18 () {56 vars in 1133 bytes} [Thu Oct 13 10:58:57 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 13 10:58:57.716435 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2306c9-53fe-42aa-b8f4-830f1bef5c2e None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:57.833208 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2306c9-53fe-42aa-b8f4-830f1bef5c2e None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:57.867884 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477e255a-40ea-4665-9f00-602f69a2e613 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:57.868108 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0a814b-302d-41fc-9a6c-3abc61c6562b None None] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:57.868364 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0a814b-302d-41fc-9a6c-3abc61c6562b None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:57.868539 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477e255a-40ea-4665-9f00-602f69a2e613 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:57.868644 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0a814b-302d-41fc-9a6c-3abc61c6562b None None] PATH_INFO: `/` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:57.868809 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477e255a-40ea-4665-9f00-602f69a2e613 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:57.869079 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477e255a-40ea-4665-9f00-602f69a2e613 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:57.870116 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 404/801] 10.222.0.18 () {54 vars in 927 bytes} [Thu Oct 13 10:58:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 13 10:58:57.874743 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa7f0da-27d7-470e-bf79-dde96247226b None None] REQUEST_METHOD: `POST` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:57.875024 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa7f0da-27d7-470e-bf79-dde96247226b None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:57.875292 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa7f0da-27d7-470e-bf79-dde96247226b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:57.879987 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477e255a-40ea-4665-9f00-602f69a2e613 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:57.881478 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477e255a-40ea-4665-9f00-602f69a2e613 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:57.894108 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.auth.core [None req-aaa7f0da-27d7-470e-bf79-dde96247226b None None] MFA Rules not processed for user `8ba31ade43694cf8bf28f7528a9ea179`. Rule list: `[]` (Enabled: `True`). {{(pid=81533) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 10:58:57.895296 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-aaa7f0da-27d7-470e-bf79-dde96247226b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 10:58:57.897532 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application [None req-477e255a-40ea-4665-9f00-602f69a2e613 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 13 10:58:57.897532 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 10:58:57.897532 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 10:58:57.897532 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 10:58:57.897532 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 10:58:57.897532 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 10:58:57.897532 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 10:58:57.897532 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 10:58:57.897532 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 10:58:57.897532 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 10:58:57.897532 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 10:58:57.897532 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 10:58:57.897532 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 13 10:58:57.897532 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 13 10:58:57.897532 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 13 10:58:57.897532 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 13 10:58:57.898465 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 10:58:57.898465 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 10:58:57.898465 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 10:58:57.898465 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 10:58:57.898465 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 10:58:57.898465 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 10:58:57.898465 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 10:58:57.898465 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application with Lock( Oct 13 10:58:57.898465 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 10:58:57.898465 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._enter() Oct 13 10:58:57.898465 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 10:58:57.898465 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 10:58:57.898465 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 10:58:57.898465 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.creator() Oct 13 10:58:57.898465 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 10:58:57.898465 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application created_value = creator( Oct 13 10:58:57.898465 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 13 10:58:57.899357 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 13 10:58:57.899357 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 13 10:58:57.899357 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application Oct 13 10:58:57.899357 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 398/802] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Oct 13 10:58:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 10:58:57.905523 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477e255a-40ea-4665-9f00-602f69a2e613 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:57.949464 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:58:57.975232 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 405/803] 10.222.0.18 () {58 vars in 1024 bytes} [Thu Oct 13 10:58:57 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 13 10:58:58.010857 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477e255a-40ea-4665-9f00-602f69a2e613 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:58.045364 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afef6089-ca98-428e-9e21-8d6ef967ac3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:58.045986 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afef6089-ca98-428e-9e21-8d6ef967ac3a None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:58.046266 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afef6089-ca98-428e-9e21-8d6ef967ac3a None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:58.046536 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afef6089-ca98-428e-9e21-8d6ef967ac3a None admin] PATH_INFO: `/v3/domains` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:58.047193 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afef6089-ca98-428e-9e21-8d6ef967ac3a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 10:58:58.047495 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afef6089-ca98-428e-9e21-8d6ef967ac3a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:58.048968 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afef6089-ca98-428e-9e21-8d6ef967ac3a None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:58.069415 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 399/804] 10.222.0.18 () {56 vars in 1109 bytes} [Thu Oct 13 10:58:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 13 10:58:58.070978 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa7f0da-27d7-470e-bf79-dde96247226b None None] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:58.153588 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:58:58.170935 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e0a492-c23e-47af-8894-560cf020ab17 None None] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:58.171214 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e0a492-c23e-47af-8894-560cf020ab17 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:58.171488 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e0a492-c23e-47af-8894-560cf020ab17 None None] PATH_INFO: `/` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:58.172804 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 400/805] 10.222.0.18 () {54 vars in 927 bytes} [Thu Oct 13 10:58:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 13 10:58:58.176858 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa7f0da-27d7-470e-bf79-dde96247226b None None] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:58.177646 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472142c8-01b0-463b-945b-437782d203ca None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:58.177929 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472142c8-01b0-463b-945b-437782d203ca None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:58.178179 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472142c8-01b0-463b-945b-437782d203ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:58.196876 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-472142c8-01b0-463b-945b-437782d203ca None None] MFA Rules not processed for user `8ba31ade43694cf8bf28f7528a9ea179`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 10:58:58.198902 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-472142c8-01b0-463b-945b-437782d203ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 10:58:58.219515 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a08c07-3882-4d2f-bf20-463e79f7a440 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:58.220144 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a08c07-3882-4d2f-bf20-463e79f7a440 None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:58.220438 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a08c07-3882-4d2f-bf20-463e79f7a440 None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:58.220734 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a08c07-3882-4d2f-bf20-463e79f7a440 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:58.228843 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a08c07-3882-4d2f-bf20-463e79f7a440 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:58.230281 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a08c07-3882-4d2f-bf20-463e79f7a440 None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:58.241781 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application [None req-49a08c07-3882-4d2f-bf20-463e79f7a440 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 13 10:58:58.241781 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 10:58:58.241781 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 10:58:58.241781 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 10:58:58.241781 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 10:58:58.241781 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 10:58:58.241781 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 10:58:58.241781 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 10:58:58.241781 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 10:58:58.241781 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 10:58:58.241781 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 10:58:58.241781 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 10:58:58.241781 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 13 10:58:58.241781 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 13 10:58:58.241781 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 13 10:58:58.242908 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 13 10:58:58.242908 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 10:58:58.242908 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 10:58:58.242908 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 10:58:58.242908 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 10:58:58.242908 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 10:58:58.242908 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 10:58:58.242908 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 10:58:58.242908 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application with Lock( Oct 13 10:58:58.242908 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 10:58:58.242908 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._enter() Oct 13 10:58:58.242908 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 10:58:58.242908 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 10:58:58.242908 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 10:58:58.242908 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.creator() Oct 13 10:58:58.242908 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 10:58:58.242908 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application created_value = creator( Oct 13 10:58:58.244007 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 13 10:58:58.244007 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 13 10:58:58.244007 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 13 10:58:58.244007 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 13 10:58:58.244007 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 13 10:58:58.244007 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 13 10:58:58.244007 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 13 10:58:58.244007 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application Oct 13 10:58:58.244007 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 406/806] 10.222.0.18 () {56 vars in 1111 bytes} [Thu Oct 13 10:58:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 10:58:58.244007 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a08c07-3882-4d2f-bf20-463e79f7a440 None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:58.272707 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 401/807] 10.222.0.18 () {58 vars in 1024 bytes} [Thu Oct 13 10:58:58 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 13 10:58:58.273582 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472142c8-01b0-463b-945b-437782d203ca None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:58.305797 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:58:58.348041 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a08c07-3882-4d2f-bf20-463e79f7a440 None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:58.378722 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472142c8-01b0-463b-945b-437782d203ca None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:58.389024 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8778963-d0ab-4e5d-9d8f-a76ad44ba946 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:58.389738 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8778963-d0ab-4e5d-9d8f-a76ad44ba946 None admin] REQUEST_METHOD: `POST` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:58.390023 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8778963-d0ab-4e5d-9d8f-a76ad44ba946 None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:58.390298 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8778963-d0ab-4e5d-9d8f-a76ad44ba946 None admin] PATH_INFO: `/v3/domains` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:58.390961 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8778963-d0ab-4e5d-9d8f-a76ad44ba946 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:58.392313 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8778963-d0ab-4e5d-9d8f-a76ad44ba946 None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:58.400970 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.sql.core [None req-c8778963-d0ab-4e5d-9d8f-a76ad44ba946 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry '<>-Default' for key 'project.ixu_project_name_domain_id'") Oct 13 10:58:58.400970 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Oct 13 10:58:58.400970 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: [parameters: {'id': 'dc66ea56d90a483f81347de26f7596ea', 'name': 'Default', 'domain_id': '<>', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': None, 'is_domain': 1}] Oct 13 10:58:58.400970 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81533) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Oct 13 10:58:58.408306 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application [None req-c8778963-d0ab-4e5d-9d8f-a76ad44ba946 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: Default.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: Default. Oct 13 10:58:58.408306 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 10:58:58.408306 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 13 10:58:58.408306 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 13 10:58:58.408306 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 13 10:58:58.408306 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 13 10:58:58.408306 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 13 10:58:58.408306 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application result = self._query(query) Oct 13 10:58:58.408306 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 13 10:58:58.408306 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application conn.query(q) Oct 13 10:58:58.408306 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 13 10:58:58.408306 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 13 10:58:58.408306 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 13 10:58:58.408306 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application result.read() Oct 13 10:58:58.409283 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 13 10:58:58.409283 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 13 10:58:58.409283 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 13 10:58:58.409283 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 13 10:58:58.409283 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 13 10:58:58.409283 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 13 10:58:58.409283 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 13 10:58:58.409283 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 13 10:58:58.409283 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry '<>-Default' for key 'project.ixu_project_name_domain_id'") Oct 13 10:58:58.409283 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application Oct 13 10:58:58.409283 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Oct 13 10:58:58.409283 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application Oct 13 10:58:58.409283 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 10:58:58.409283 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Oct 13 10:58:58.409283 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return method(*args, **kwargs) Oct 13 10:58:58.409283 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Oct 13 10:58:58.409283 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return project_ref.to_dict() Oct 13 10:58:58.409283 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 13 10:58:58.410352 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application next(self.gen) Oct 13 10:58:58.410352 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Oct 13 10:58:58.410352 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application yield resource Oct 13 10:58:58.410352 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 13 10:58:58.410352 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application next(self.gen) Oct 13 10:58:58.410352 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Oct 13 10:58:58.410352 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application self.session.rollback() Oct 13 10:58:58.410352 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 13 10:58:58.410352 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application self.force_reraise() Oct 13 10:58:58.410352 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 13 10:58:58.410352 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application raise self.value Oct 13 10:58:58.410352 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Oct 13 10:58:58.410352 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Oct 13 10:58:58.410352 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Oct 13 10:58:58.410352 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application session.commit() Oct 13 10:58:58.410352 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Oct 13 10:58:58.410352 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Oct 13 10:58:58.411285 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Oct 13 10:58:58.411285 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application self._prepare_impl() Oct 13 10:58:58.411285 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Oct 13 10:58:58.411285 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application self.session.flush() Oct 13 10:58:58.411285 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 13 10:58:58.411285 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application self._flush(objects) Oct 13 10:58:58.411285 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 13 10:58:58.411285 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Oct 13 10:58:58.411285 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 13 10:58:58.411285 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application compat.raise_( Oct 13 10:58:58.411285 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 13 10:58:58.411285 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application raise exception Oct 13 10:58:58.411285 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 13 10:58:58.411285 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application flush_context.execute() Oct 13 10:58:58.411285 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 13 10:58:58.411285 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application rec.execute(self) Oct 13 10:58:58.411285 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 13 10:58:58.412194 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Oct 13 10:58:58.412194 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 13 10:58:58.412194 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application _emit_insert_statements( Oct 13 10:58:58.412194 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Oct 13 10:58:58.412194 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application c = connection._execute_20( Oct 13 10:58:58.412194 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 13 10:58:58.412194 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Oct 13 10:58:58.412194 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 13 10:58:58.412194 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Oct 13 10:58:58.412194 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 13 10:58:58.412194 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application ret = self._execute_context( Oct 13 10:58:58.412194 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 13 10:58:58.412194 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Oct 13 10:58:58.412194 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 13 10:58:58.412194 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 13 10:58:58.413107 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 13 10:58:58.413107 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application raise exception Oct 13 10:58:58.413107 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 13 10:58:58.413107 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 13 10:58:58.413107 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 13 10:58:58.413107 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 13 10:58:58.413107 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 13 10:58:58.413107 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application result = self._query(query) Oct 13 10:58:58.413107 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 13 10:58:58.413107 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application conn.query(q) Oct 13 10:58:58.413107 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 13 10:58:58.413107 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 13 10:58:58.413107 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 13 10:58:58.413107 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application result.read() Oct 13 10:58:58.413107 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 13 10:58:58.413107 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 13 10:58:58.413107 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 13 10:58:58.414008 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 13 10:58:58.414008 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 13 10:58:58.414008 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 13 10:58:58.414008 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 13 10:58:58.414008 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 13 10:58:58.414008 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry '<>-Default' for key 'project.ixu_project_name_domain_id'") Oct 13 10:58:58.414008 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Oct 13 10:58:58.414008 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application [parameters: {'id': 'dc66ea56d90a483f81347de26f7596ea', 'name': 'Default', 'domain_id': '<>', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': None, 'is_domain': 1}] Oct 13 10:58:58.414008 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 13 10:58:58.414008 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application Oct 13 10:58:58.414008 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 13 10:58:58.414008 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application Oct 13 10:58:58.414008 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 10:58:58.414008 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Oct 13 10:58:58.414008 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Oct 13 10:58:58.417275 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Oct 13 10:58:58.417275 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Oct 13 10:58:58.417275 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name Default. Oct 13 10:58:58.417275 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application Oct 13 10:58:58.417275 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 13 10:58:58.417275 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application Oct 13 10:58:58.417275 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 10:58:58.417275 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 10:58:58.417275 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 10:58:58.417275 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 10:58:58.417275 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 10:58:58.417275 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 10:58:58.417275 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 10:58:58.417275 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 10:58:58.417275 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 10:58:58.417275 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 10:58:58.417275 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 10:58:58.420948 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 128, in post Oct 13 10:58:58.420948 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_domain( Oct 13 10:58:58.420948 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 10:58:58.420948 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 10:58:58.420948 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 765, in create_domain Oct 13 10:58:58.420948 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application is_domain_project = self.create_project( Oct 13 10:58:58.420948 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 10:58:58.420948 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 10:58:58.420948 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Oct 13 10:58:58.420948 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application raise exception.Conflict( Oct 13 10:58:58.420948 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: Default. Oct 13 10:58:58.420948 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application Oct 13 10:58:58.420948 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 407/808] 10.222.0.18 () {60 vars in 1137 bytes} [Thu Oct 13 10:58:58 2022] POST /identity/v3/domains => generated 190 bytes in 166 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Oct 13 10:58:58.420948 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8778963-d0ab-4e5d-9d8f-a76ad44ba946 None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:58.425191 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:58:58.426344 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80949c4a-06ef-4c6a-928d-5aa56727b770 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:58.427132 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80949c4a-06ef-4c6a-928d-5aa56727b770 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:58.427304 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80949c4a-06ef-4c6a-928d-5aa56727b770 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:58.427482 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80949c4a-06ef-4c6a-928d-5aa56727b770 None admin] PATH_INFO: `/v3/projects` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:58.428802 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80949c4a-06ef-4c6a-928d-5aa56727b770 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 10:58:58.429082 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80949c4a-06ef-4c6a-928d-5aa56727b770 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:58.430519 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80949c4a-06ef-4c6a-928d-5aa56727b770 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:58.442407 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 402/809] 10.222.0.18 () {56 vars in 1148 bytes} [Thu Oct 13 10:58:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 10:58:58.448231 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80949c4a-06ef-4c6a-928d-5aa56727b770 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:58.530091 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8778963-d0ab-4e5d-9d8f-a76ad44ba946 None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:58.546672 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:58:58.557632 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80949c4a-06ef-4c6a-928d-5aa56727b770 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:58.564387 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8999ffa9-4112-43a7-babf-f2c90fc0d31f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:58.565021 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8999ffa9-4112-43a7-babf-f2c90fc0d31f None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:58.565304 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8999ffa9-4112-43a7-babf-f2c90fc0d31f None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:58.565572 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8999ffa9-4112-43a7-babf-f2c90fc0d31f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:58.576669 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8999ffa9-4112-43a7-babf-f2c90fc0d31f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:58.578152 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8999ffa9-4112-43a7-babf-f2c90fc0d31f None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:58.590906 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41d2310-7c71-4045-a4d5-4ca0ad0ef1fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:58.591563 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41d2310-7c71-4045-a4d5-4ca0ad0ef1fc None admin] REQUEST_METHOD: `PUT` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:58.591945 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41d2310-7c71-4045-a4d5-4ca0ad0ef1fc None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:58.592220 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41d2310-7c71-4045-a4d5-4ca0ad0ef1fc None admin] PATH_INFO: `/v3/projects/112613528384453abe7506465609fbd8/users/bc5b13f97c0e4a31940b5b73a916af29/roles/e6e5c2b89fa04f0ca6cb23159febaa30` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:58.592739 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application [None req-8999ffa9-4112-43a7-babf-f2c90fc0d31f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 13 10:58:58.592739 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 10:58:58.592739 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 10:58:58.592739 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 10:58:58.592739 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 10:58:58.592739 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 10:58:58.592739 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 10:58:58.592739 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 10:58:58.592739 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 10:58:58.592739 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 10:58:58.592739 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 10:58:58.592739 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 10:58:58.592739 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 13 10:58:58.592739 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 13 10:58:58.592739 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 13 10:58:58.592739 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 13 10:58:58.593968 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 10:58:58.593968 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 10:58:58.593968 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 10:58:58.593968 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 10:58:58.593968 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 10:58:58.593968 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 10:58:58.593968 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 10:58:58.593968 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application with Lock( Oct 13 10:58:58.593968 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 10:58:58.593968 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._enter() Oct 13 10:58:58.593968 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 10:58:58.593968 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 10:58:58.593968 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 10:58:58.593968 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.creator() Oct 13 10:58:58.593968 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 10:58:58.593968 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application created_value = creator( Oct 13 10:58:58.593968 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 13 10:58:58.595265 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 13 10:58:58.595265 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 13 10:58:58.595265 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application Oct 13 10:58:58.595265 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 408/810] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Oct 13 10:58:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 13 10:58:58.595265 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8999ffa9-4112-43a7-babf-f2c90fc0d31f None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:58.600143 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41d2310-7c71-4045-a4d5-4ca0ad0ef1fc None admin] RBAC: Authorizing `identity:create_grant(project_id=112613528384453abe7506465609fbd8, user_id=bc5b13f97c0e4a31940b5b73a916af29, role_id=e6e5c2b89fa04f0ca6cb23159febaa30)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:58.601956 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41d2310-7c71-4045-a4d5-4ca0ad0ef1fc None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:58.614895 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 403/811] 10.222.0.18 () {58 vars in 1439 bytes} [Thu Oct 13 10:58:58 2022] PUT /identity/v3/projects/112613528384453abe7506465609fbd8/users/bc5b13f97c0e4a31940b5b73a916af29/roles/e6e5c2b89fa04f0ca6cb23159febaa30 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 10:58:58.616337 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41d2310-7c71-4045-a4d5-4ca0ad0ef1fc None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:58.665717 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:58:58.714470 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8999ffa9-4112-43a7-babf-f2c90fc0d31f None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:58.747270 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41d2310-7c71-4045-a4d5-4ca0ad0ef1fc None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:58.763552 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d342878d-c153-4d70-b826-82b56ef5aafa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:58.764294 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d342878d-c153-4d70-b826-82b56ef5aafa None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:58.764581 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d342878d-c153-4d70-b826-82b56ef5aafa None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:58.764855 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d342878d-c153-4d70-b826-82b56ef5aafa None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:58.778027 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d342878d-c153-4d70-b826-82b56ef5aafa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 13 10:58:58.782878 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application [None req-d342878d-c153-4d70-b826-82b56ef5aafa None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 13 10:58:58.782878 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 10:58:58.782878 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 10:58:58.782878 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 10:58:58.782878 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 10:58:58.782878 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 10:58:58.782878 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 10:58:58.782878 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 10:58:58.782878 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 10:58:58.782878 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 10:58:58.782878 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 10:58:58.782878 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 10:58:58.782878 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 13 10:58:58.782878 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 13 10:58:58.782878 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 13 10:58:58.782878 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 13 10:58:58.783874 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 13 10:58:58.783874 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 13 10:58:58.783874 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 13 10:58:58.783874 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 13 10:58:58.783874 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 10:58:58.783874 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 10:58:58.783874 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 10:58:58.783874 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 10:58:58.783874 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 10:58:58.783874 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 10:58:58.783874 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 10:58:58.783874 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application with Lock( Oct 13 10:58:58.783874 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 10:58:58.783874 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._enter() Oct 13 10:58:58.783874 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 10:58:58.783874 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 10:58:58.784735 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 10:58:58.784735 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.creator() Oct 13 10:58:58.784735 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 10:58:58.784735 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application created_value = creator( Oct 13 10:58:58.784735 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 13 10:58:58.784735 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 13 10:58:58.784735 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 13 10:58:58.784735 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 13 10:58:58.784735 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 13 10:58:58.784735 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 13 10:58:58.784735 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 13 10:58:58.784735 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application Oct 13 10:58:58.784735 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 409/812] 10.222.0.18 () {56 vars in 1096 bytes} [Thu Oct 13 10:58:58 2022] GET /identity/v3/roles/admin => generated 83 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 10:58:58.790966 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d342878d-c153-4d70-b826-82b56ef5aafa None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:58.791807 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a929b5a-ed37-4c6f-95aa-517126aeb535 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:58.792421 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a929b5a-ed37-4c6f-95aa-517126aeb535 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:58.792697 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a929b5a-ed37-4c6f-95aa-517126aeb535 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:58.792967 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a929b5a-ed37-4c6f-95aa-517126aeb535 None admin] PATH_INFO: `/v3/domains` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:58.793766 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a929b5a-ed37-4c6f-95aa-517126aeb535 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 10:58:58.794076 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a929b5a-ed37-4c6f-95aa-517126aeb535 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:58.795439 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a929b5a-ed37-4c6f-95aa-517126aeb535 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:58.811283 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 404/813] 10.222.0.18 () {56 vars in 1109 bytes} [Thu Oct 13 10:58:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 10:58:58.911588 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d342878d-c153-4d70-b826-82b56ef5aafa None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:58.931209 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:58:58.950658 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e25334-e048-4f61-a45b-ff664daf516c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:58.951375 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e25334-e048-4f61-a45b-ff664daf516c None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:58.951721 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e25334-e048-4f61-a45b-ff664daf516c None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:58.952063 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e25334-e048-4f61-a45b-ff664daf516c None admin] PATH_INFO: `/v3/roles` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:58.952796 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e25334-e048-4f61-a45b-ff664daf516c None admin] RBAC: Adding query filter params (name=admin) {{(pid=81533) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 10:58:58.953236 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e25334-e048-4f61-a45b-ff664daf516c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:58.954738 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e25334-e048-4f61-a45b-ff664daf516c None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:58.969460 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 410/814] 10.222.0.18 () {56 vars in 1099 bytes} [Thu Oct 13 10:58:58 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 13 10:58:58.971364 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a929b5a-ed37-4c6f-95aa-517126aeb535 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:58.984798 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:58:59.086303 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a929b5a-ed37-4c6f-95aa-517126aeb535 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:59.124974 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3fe174-dc48-4e77-b5ee-178a4cecdb17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:59.125624 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3fe174-dc48-4e77-b5ee-178a4cecdb17 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:59.125900 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3fe174-dc48-4e77-b5ee-178a4cecdb17 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:59.126171 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3fe174-dc48-4e77-b5ee-178a4cecdb17 None admin] PATH_INFO: `/v3/users/d53da8e068a642e3a18e02bacd14a924` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:59.141692 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d3fe174-dc48-4e77-b5ee-178a4cecdb17 None admin] RBAC: Authorizing `identity:get_user(user_id=d53da8e068a642e3a18e02bacd14a924)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:59.143112 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d3fe174-dc48-4e77-b5ee-178a4cecdb17 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:59.144952 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 405/815] 10.222.0.18 () {56 vars in 1177 bytes} [Thu Oct 13 10:58:58 2022] GET /identity/v3/users/d53da8e068a642e3a18e02bacd14a924 => generated 285 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 13 10:58:59.151164 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e25334-e048-4f61-a45b-ff664daf516c None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:59.248269 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e25334-e048-4f61-a45b-ff664daf516c None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:59.282016 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196d3004-db05-4377-8be7-0b1a22adfc64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:59.282638 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196d3004-db05-4377-8be7-0b1a22adfc64 None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:59.282913 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196d3004-db05-4377-8be7-0b1a22adfc64 None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:59.283181 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196d3004-db05-4377-8be7-0b1a22adfc64 None admin] PATH_INFO: `/v3/projects/2313de78743546e6856f9530fb0460c4` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:59.284282 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196d3004-db05-4377-8be7-0b1a22adfc64 None admin] RBAC: Authorizing `identity:get_project(project_id=2313de78743546e6856f9530fb0460c4)` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:59.285734 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196d3004-db05-4377-8be7-0b1a22adfc64 None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:59.287358 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 411/816] 10.222.0.18 () {56 vars in 1186 bytes} [Thu Oct 13 10:58:59 2022] GET /identity/v3/projects/2313de78743546e6856f9530fb0460c4 => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 10:58:59.293532 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3fe174-dc48-4e77-b5ee-178a4cecdb17 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:58:59.357871 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:58:59.391167 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3fe174-dc48-4e77-b5ee-178a4cecdb17 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:58:59.423613 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30659f5f-62c6-407b-bff7-1ea9e8cc3833 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:58:59.424282 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30659f5f-62c6-407b-bff7-1ea9e8cc3833 None admin] REQUEST_METHOD: `PUT` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:58:59.424615 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30659f5f-62c6-407b-bff7-1ea9e8cc3833 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:58:59.424866 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30659f5f-62c6-407b-bff7-1ea9e8cc3833 None admin] PATH_INFO: `/v3/projects/2313de78743546e6856f9530fb0460c4/users/d53da8e068a642e3a18e02bacd14a924/roles/30a6d59262144d4d956f4d4207864030` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:58:59.426926 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30659f5f-62c6-407b-bff7-1ea9e8cc3833 None admin] RBAC: Authorizing `identity:create_grant(project_id=2313de78743546e6856f9530fb0460c4, user_id=d53da8e068a642e3a18e02bacd14a924, role_id=30a6d59262144d4d956f4d4207864030)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:58:59.428905 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30659f5f-62c6-407b-bff7-1ea9e8cc3833 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:58:59.441392 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 406/817] 10.222.0.18 () {58 vars in 1439 bytes} [Thu Oct 13 10:58:59 2022] PUT /identity/v3/projects/2313de78743546e6856f9530fb0460c4/users/d53da8e068a642e3a18e02bacd14a924/roles/30a6d59262144d4d956f4d4207864030 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 10:59:00.804159 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638810c2-159e-4085-9a55-132b253f8a10 None None] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:59:00.804682 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638810c2-159e-4085-9a55-132b253f8a10 None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:59:00.804770 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638810c2-159e-4085-9a55-132b253f8a10 None None] PATH_INFO: `/` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:59:00.806079 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 412/818] 10.222.0.18 () {54 vars in 927 bytes} [Thu Oct 13 10:59:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 10:59:00.811498 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fd6f6e-0392-4fbb-b5e9-50bc8932af66 None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:59:00.811914 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fd6f6e-0392-4fbb-b5e9-50bc8932af66 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:59:00.812032 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fd6f6e-0392-4fbb-b5e9-50bc8932af66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:59:00.830383 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-a8fd6f6e-0392-4fbb-b5e9-50bc8932af66 None None] MFA Rules not processed for user `8ba31ade43694cf8bf28f7528a9ea179`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 10:59:00.831560 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-a8fd6f6e-0392-4fbb-b5e9-50bc8932af66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 10:59:00.895600 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 407/819] 10.222.0.18 () {58 vars in 1024 bytes} [Thu Oct 13 10:59:00 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 13 10:59:01.164349 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638810c2-159e-4085-9a55-132b253f8a10 None None] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:59:01.215667 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:59:01.266020 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638810c2-159e-4085-9a55-132b253f8a10 None None] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:59:01.298667 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f62425-8c6e-44d8-8897-46fdaa9dec5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:59:01.299291 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f62425-8c6e-44d8-8897-46fdaa9dec5c None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:59:01.299567 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f62425-8c6e-44d8-8897-46fdaa9dec5c None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:59:01.299835 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f62425-8c6e-44d8-8897-46fdaa9dec5c None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:59:01.310356 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f62425-8c6e-44d8-8897-46fdaa9dec5c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 13 10:59:01.315118 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application [None req-19f62425-8c6e-44d8-8897-46fdaa9dec5c None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 13 10:59:01.315118 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 10:59:01.315118 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 10:59:01.315118 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 10:59:01.315118 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 10:59:01.315118 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 10:59:01.315118 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 10:59:01.315118 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 10:59:01.315118 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 10:59:01.315118 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 10:59:01.315118 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 10:59:01.315118 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 10:59:01.315118 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 13 10:59:01.315118 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 13 10:59:01.315118 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 13 10:59:01.315118 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 13 10:59:01.316226 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 13 10:59:01.316226 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 13 10:59:01.316226 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 13 10:59:01.316226 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 13 10:59:01.316226 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 10:59:01.316226 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 10:59:01.316226 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 10:59:01.316226 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 10:59:01.316226 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 10:59:01.316226 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 10:59:01.316226 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 10:59:01.316226 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application with Lock( Oct 13 10:59:01.316226 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 10:59:01.316226 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._enter() Oct 13 10:59:01.316226 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 10:59:01.316226 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 10:59:01.317111 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 10:59:01.317111 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.creator() Oct 13 10:59:01.317111 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 10:59:01.317111 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application created_value = creator( Oct 13 10:59:01.317111 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 13 10:59:01.317111 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 13 10:59:01.317111 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 13 10:59:01.317111 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 13 10:59:01.317111 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 13 10:59:01.317111 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 13 10:59:01.317111 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 13 10:59:01.317111 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application Oct 13 10:59:01.317111 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 413/820] 10.222.0.18 () {56 vars in 1120 bytes} [Thu Oct 13 10:59:01 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 10:59:01.322812 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8fd6f6e-0392-4fbb-b5e9-50bc8932af66 None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:59:01.378270 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:59:01.420824 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8fd6f6e-0392-4fbb-b5e9-50bc8932af66 None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:59:01.456044 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03962b79-0873-4d30-a28e-3024357063a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:59:01.456676 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03962b79-0873-4d30-a28e-3024357063a7 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:59:01.456956 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03962b79-0873-4d30-a28e-3024357063a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:59:01.457266 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03962b79-0873-4d30-a28e-3024357063a7 None admin] PATH_INFO: `/v3/roles` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:59:01.457962 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03962b79-0873-4d30-a28e-3024357063a7 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 10:59:01.458264 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03962b79-0873-4d30-a28e-3024357063a7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:59:01.459703 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03962b79-0873-4d30-a28e-3024357063a7 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:59:01.468957 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 408/821] 10.222.0.18 () {56 vars in 1115 bytes} [Thu Oct 13 10:59:01 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 10:59:01.475117 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f62425-8c6e-44d8-8897-46fdaa9dec5c None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:59:01.575625 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f62425-8c6e-44d8-8897-46fdaa9dec5c None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:59:01.575827 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d636573a-a506-4d7b-94c8-82b1a9ab6131 None None] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:59:01.576003 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d636573a-a506-4d7b-94c8-82b1a9ab6131 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:59:01.576279 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d636573a-a506-4d7b-94c8-82b1a9ab6131 None None] PATH_INFO: `/` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:59:01.577630 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 409/822] 10.222.0.18 () {54 vars in 927 bytes} [Thu Oct 13 10:59:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 13 10:59:01.582585 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80f82ae-60b9-469c-b9af-0c85522cf239 None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:59:01.582864 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80f82ae-60b9-469c-b9af-0c85522cf239 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:59:01.583138 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80f82ae-60b9-469c-b9af-0c85522cf239 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:59:01.585210 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:59:01.601798 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-f80f82ae-60b9-469c-b9af-0c85522cf239 None None] MFA Rules not processed for user `8ba31ade43694cf8bf28f7528a9ea179`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 10:59:01.602977 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-f80f82ae-60b9-469c-b9af-0c85522cf239 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 10:59:01.610875 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f244f2c9-3565-418e-991a-b58f2316cab5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:59:01.611494 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f244f2c9-3565-418e-991a-b58f2316cab5 None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:59:01.611769 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f244f2c9-3565-418e-991a-b58f2316cab5 None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:59:01.612043 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f244f2c9-3565-418e-991a-b58f2316cab5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:59:01.622678 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f244f2c9-3565-418e-991a-b58f2316cab5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:59:01.624107 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f244f2c9-3565-418e-991a-b58f2316cab5 None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:59:01.639418 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application [None req-f244f2c9-3565-418e-991a-b58f2316cab5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 13 10:59:01.639418 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 10:59:01.639418 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 10:59:01.639418 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 10:59:01.639418 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 10:59:01.639418 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 10:59:01.639418 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 10:59:01.639418 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 10:59:01.639418 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 10:59:01.639418 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 10:59:01.639418 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 10:59:01.639418 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 10:59:01.639418 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 13 10:59:01.639418 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 13 10:59:01.639418 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 13 10:59:01.639418 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 13 10:59:01.640569 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 10:59:01.640569 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 10:59:01.640569 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 10:59:01.640569 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 10:59:01.640569 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 10:59:01.640569 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 10:59:01.640569 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 10:59:01.640569 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application with Lock( Oct 13 10:59:01.640569 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 10:59:01.640569 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._enter() Oct 13 10:59:01.640569 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 10:59:01.640569 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 10:59:01.640569 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 10:59:01.640569 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.creator() Oct 13 10:59:01.640569 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 10:59:01.640569 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application created_value = creator( Oct 13 10:59:01.640569 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 13 10:59:01.641699 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 13 10:59:01.641699 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 13 10:59:01.641699 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application Oct 13 10:59:01.641699 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 414/823] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Oct 13 10:59:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 10:59:01.646182 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f244f2c9-3565-418e-991a-b58f2316cab5 None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:59:01.672645 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 410/824] 10.222.0.18 () {58 vars in 1024 bytes} [Thu Oct 13 10:59:01 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 13 10:59:01.748655 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f244f2c9-3565-418e-991a-b58f2316cab5 None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:59:01.782893 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197471e0-828c-4444-b7ad-9922e75097d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:59:01.783482 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197471e0-828c-4444-b7ad-9922e75097d9 None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:59:01.783758 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197471e0-828c-4444-b7ad-9922e75097d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:59:01.784029 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197471e0-828c-4444-b7ad-9922e75097d9 None admin] PATH_INFO: `/v3/domains` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:59:01.784659 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197471e0-828c-4444-b7ad-9922e75097d9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81533) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 10:59:01.784959 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197471e0-828c-4444-b7ad-9922e75097d9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:59:01.786343 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197471e0-828c-4444-b7ad-9922e75097d9 None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:59:01.797318 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 415/825] 10.222.0.18 () {56 vars in 1109 bytes} [Thu Oct 13 10:59:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 13 10:59:01.803162 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80f82ae-60b9-469c-b9af-0c85522cf239 None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:59:01.852003 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:59:01.900965 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80f82ae-60b9-469c-b9af-0c85522cf239 None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:59:01.934264 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b748e77-216c-495f-8db9-df4fad0406f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:59:01.934823 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b748e77-216c-495f-8db9-df4fad0406f8 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:59:01.935102 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b748e77-216c-495f-8db9-df4fad0406f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:59:01.935373 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b748e77-216c-495f-8db9-df4fad0406f8 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:59:01.942131 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b748e77-216c-495f-8db9-df4fad0406f8 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:59:01.943577 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197471e0-828c-4444-b7ad-9922e75097d9 None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:59:01.944035 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b748e77-216c-495f-8db9-df4fad0406f8 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:59:01.956353 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application [None req-8b748e77-216c-495f-8db9-df4fad0406f8 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 13 10:59:01.956353 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 10:59:01.956353 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 10:59:01.956353 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 10:59:01.956353 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 10:59:01.956353 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 10:59:01.956353 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 10:59:01.956353 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 10:59:01.956353 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 10:59:01.956353 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 10:59:01.956353 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 10:59:01.956353 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 10:59:01.956353 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 13 10:59:01.956353 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 13 10:59:01.956353 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 13 10:59:01.956353 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 13 10:59:01.957436 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 10:59:01.957436 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 10:59:01.957436 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 13 10:59:01.957436 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 13 10:59:01.957436 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 13 10:59:01.957436 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 13 10:59:01.957436 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 10:59:01.957436 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 10:59:01.957436 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 10:59:01.957436 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 10:59:01.957436 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 10:59:01.957436 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application with Lock( Oct 13 10:59:01.957436 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 10:59:01.957436 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._enter() Oct 13 10:59:01.957436 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 10:59:01.957436 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 10:59:01.957436 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 10:59:01.957436 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.creator() Oct 13 10:59:01.958480 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 10:59:01.958480 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application created_value = creator( Oct 13 10:59:01.958480 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 13 10:59:01.958480 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 13 10:59:01.958480 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 13 10:59:01.958480 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 13 10:59:01.958480 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 13 10:59:01.958480 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 13 10:59:01.958480 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 13 10:59:01.958480 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application Oct 13 10:59:01.958480 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 411/826] 10.222.0.18 () {56 vars in 1093 bytes} [Thu Oct 13 10:59:01 2022] GET /identity/v3/users/nova => generated 82 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 10:59:01.963862 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b748e77-216c-495f-8db9-df4fad0406f8 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:59:01.966291 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:59:02.045515 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197471e0-828c-4444-b7ad-9922e75097d9 None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:59:02.061973 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b748e77-216c-495f-8db9-df4fad0406f8 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:59:02.072035 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:59:02.078836 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e393e7-29e7-490e-b3bb-b96528ec147c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:59:02.079462 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e393e7-29e7-490e-b3bb-b96528ec147c None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:59:02.079740 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e393e7-29e7-490e-b3bb-b96528ec147c None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:59:02.080013 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e393e7-29e7-490e-b3bb-b96528ec147c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:59:02.091074 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e393e7-29e7-490e-b3bb-b96528ec147c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 13 10:59:02.095897 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application [None req-b8e393e7-29e7-490e-b3bb-b96528ec147c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 13 10:59:02.095897 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 10:59:02.095897 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 10:59:02.095897 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 10:59:02.095897 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 10:59:02.095897 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 10:59:02.095897 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 10:59:02.095897 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 10:59:02.095897 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 10:59:02.095897 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 10:59:02.095897 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 10:59:02.095897 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 10:59:02.095897 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 13 10:59:02.095897 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 13 10:59:02.095897 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 13 10:59:02.095897 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 13 10:59:02.097093 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 13 10:59:02.097093 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 13 10:59:02.097093 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 13 10:59:02.097093 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 13 10:59:02.097093 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 10:59:02.097093 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 10:59:02.097093 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 10:59:02.097093 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 10:59:02.097093 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 10:59:02.097093 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 10:59:02.097093 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 10:59:02.097093 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application with Lock( Oct 13 10:59:02.097093 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 10:59:02.097093 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._enter() Oct 13 10:59:02.097093 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 10:59:02.097093 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 10:59:02.098265 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 10:59:02.098265 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.creator() Oct 13 10:59:02.098265 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 10:59:02.098265 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application created_value = creator( Oct 13 10:59:02.098265 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 13 10:59:02.098265 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 13 10:59:02.098265 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 13 10:59:02.098265 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 13 10:59:02.098265 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 13 10:59:02.098265 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 13 10:59:02.098265 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 13 10:59:02.098265 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application Oct 13 10:59:02.098265 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 416/827] 10.222.0.18 () {56 vars in 1096 bytes} [Thu Oct 13 10:59:01 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 13 10:59:02.099790 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2092fa3-46f4-4b3f-8355-783f4f54f600 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:59:02.100651 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2092fa3-46f4-4b3f-8355-783f4f54f600 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:59:02.100869 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2092fa3-46f4-4b3f-8355-783f4f54f600 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:59:02.101232 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2092fa3-46f4-4b3f-8355-783f4f54f600 None admin] PATH_INFO: `/v3/users` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:59:02.102306 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2092fa3-46f4-4b3f-8355-783f4f54f600 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 10:59:02.102622 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2092fa3-46f4-4b3f-8355-783f4f54f600 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:59:02.102958 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e393e7-29e7-490e-b3bb-b96528ec147c None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:59:02.104025 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2092fa3-46f4-4b3f-8355-783f4f54f600 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:59:02.122003 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 412/828] 10.222.0.18 () {56 vars in 1133 bytes} [Thu Oct 13 10:59:01 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 10:59:02.127857 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2092fa3-46f4-4b3f-8355-783f4f54f600 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:59:02.182833 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:59:02.202645 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e393e7-29e7-490e-b3bb-b96528ec147c None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:59:02.226589 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2092fa3-46f4-4b3f-8355-783f4f54f600 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:59:02.235123 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7e2224-a39c-4e06-aea0-44950806d7b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:59:02.235726 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7e2224-a39c-4e06-aea0-44950806d7b2 None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:59:02.236005 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7e2224-a39c-4e06-aea0-44950806d7b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:59:02.236277 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7e2224-a39c-4e06-aea0-44950806d7b2 None admin] PATH_INFO: `/v3/roles` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:59:02.236941 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7e2224-a39c-4e06-aea0-44950806d7b2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81533) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 10:59:02.237275 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7e2224-a39c-4e06-aea0-44950806d7b2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:59:02.238634 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7e2224-a39c-4e06-aea0-44950806d7b2 None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:59:02.247900 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 417/829] 10.222.0.18 () {56 vars in 1099 bytes} [Thu Oct 13 10:59:02 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 13 10:59:02.253762 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7e2224-a39c-4e06-aea0-44950806d7b2 None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:59:02.265957 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8a3aec-83c5-4760-afc8-3b9d44af9f70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:59:02.266559 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8a3aec-83c5-4760-afc8-3b9d44af9f70 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:59:02.266836 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8a3aec-83c5-4760-afc8-3b9d44af9f70 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:59:02.267196 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8a3aec-83c5-4760-afc8-3b9d44af9f70 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:59:02.299767 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:59:02.334148 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b8a3aec-83c5-4760-afc8-3b9d44af9f70 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:59:02.335633 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b8a3aec-83c5-4760-afc8-3b9d44af9f70 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:59:02.351287 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7e2224-a39c-4e06-aea0-44950806d7b2 None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:59:02.385171 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6304f233-4c31-462d-bcf1-f20fb8796294 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:59:02.385794 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6304f233-4c31-462d-bcf1-f20fb8796294 None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:59:02.386071 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6304f233-4c31-462d-bcf1-f20fb8796294 None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:59:02.386345 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6304f233-4c31-462d-bcf1-f20fb8796294 None admin] PATH_INFO: `/v3/users/d53da8e068a642e3a18e02bacd14a924` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:59:02.387467 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6304f233-4c31-462d-bcf1-f20fb8796294 None admin] RBAC: Authorizing `identity:get_user(user_id=d53da8e068a642e3a18e02bacd14a924)` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:59:02.388886 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6304f233-4c31-462d-bcf1-f20fb8796294 None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:59:02.390639 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 418/830] 10.222.0.18 () {56 vars in 1177 bytes} [Thu Oct 13 10:59:02 2022] GET /identity/v3/users/d53da8e068a642e3a18e02bacd14a924 => generated 285 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 13 10:59:02.396085 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6304f233-4c31-462d-bcf1-f20fb8796294 None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:59:02.408524 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:59:02.434545 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 413/831] 10.222.0.18 () {58 vars in 1282 bytes} [Thu Oct 13 10:59:02 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Oct 13 10:59:02.440087 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8a3aec-83c5-4760-afc8-3b9d44af9f70 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:59:02.499321 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6304f233-4c31-462d-bcf1-f20fb8796294 None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:59:02.504497 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:59:02.532560 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b3551b-6e6d-49bf-be0b-685a2e683472 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:59:02.533194 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b3551b-6e6d-49bf-be0b-685a2e683472 None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:59:02.533480 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b3551b-6e6d-49bf-be0b-685a2e683472 None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:59:02.533753 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b3551b-6e6d-49bf-be0b-685a2e683472 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:59:02.536361 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8a3aec-83c5-4760-afc8-3b9d44af9f70 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:59:02.570455 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbdf2d71-faf2-4d4a-82a1-db0f52a20795 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:59:02.571074 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdf2d71-faf2-4d4a-82a1-db0f52a20795 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:59:02.571355 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdf2d71-faf2-4d4a-82a1-db0f52a20795 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:59:02.571625 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdf2d71-faf2-4d4a-82a1-db0f52a20795 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:59:02.581794 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbdf2d71-faf2-4d4a-82a1-db0f52a20795 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:59:02.583220 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbdf2d71-faf2-4d4a-82a1-db0f52a20795 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:59:02.597340 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application [None req-cbdf2d71-faf2-4d4a-82a1-db0f52a20795 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 13 10:59:02.597340 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 10:59:02.597340 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 10:59:02.597340 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 10:59:02.597340 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 10:59:02.597340 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 10:59:02.597340 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 10:59:02.597340 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 10:59:02.597340 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 10:59:02.597340 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 10:59:02.597340 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 10:59:02.597340 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 10:59:02.597340 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 13 10:59:02.597340 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 13 10:59:02.597340 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 13 10:59:02.597340 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 13 10:59:02.598486 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 10:59:02.598486 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 10:59:02.598486 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 10:59:02.598486 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 10:59:02.598486 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 10:59:02.598486 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 10:59:02.598486 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 10:59:02.598486 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application with Lock( Oct 13 10:59:02.598486 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 10:59:02.598486 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._enter() Oct 13 10:59:02.598486 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 10:59:02.598486 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 10:59:02.598486 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 10:59:02.598486 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.creator() Oct 13 10:59:02.598486 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 10:59:02.598486 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application created_value = creator( Oct 13 10:59:02.598486 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 13 10:59:02.599429 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 13 10:59:02.599429 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 13 10:59:02.599429 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application Oct 13 10:59:02.599429 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 414/832] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Oct 13 10:59:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 13 10:59:02.600967 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b3551b-6e6d-49bf-be0b-685a2e683472 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:59:02.602668 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b3551b-6e6d-49bf-be0b-685a2e683472 None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:59:02.604741 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbdf2d71-faf2-4d4a-82a1-db0f52a20795 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:59:02.613880 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:59:02.701662 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbdf2d71-faf2-4d4a-82a1-db0f52a20795 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:59:02.701847 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 419/833] 10.222.0.18 () {58 vars in 1282 bytes} [Thu Oct 13 10:59:02 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Oct 13 10:59:02.707496 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b3551b-6e6d-49bf-be0b-685a2e683472 None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:59:02.721681 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:59:02.742447 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db05f1aa-e9e3-412d-91df-c66c470494ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:59:02.743051 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db05f1aa-e9e3-412d-91df-c66c470494ec None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:59:02.743326 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db05f1aa-e9e3-412d-91df-c66c470494ec None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:59:02.743594 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db05f1aa-e9e3-412d-91df-c66c470494ec None admin] PATH_INFO: `/v3/domains` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:59:02.744230 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db05f1aa-e9e3-412d-91df-c66c470494ec None admin] RBAC: Adding query filter params (name=Default) {{(pid=81534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 10:59:02.744527 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db05f1aa-e9e3-412d-91df-c66c470494ec None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:59:02.745906 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db05f1aa-e9e3-412d-91df-c66c470494ec None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:59:02.758602 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 415/834] 10.222.0.18 () {56 vars in 1109 bytes} [Thu Oct 13 10:59:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 13 10:59:02.764104 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db05f1aa-e9e3-412d-91df-c66c470494ec None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:59:02.804686 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b3551b-6e6d-49bf-be0b-685a2e683472 None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:59:02.815094 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:59:02.839110 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43405427-bc51-4d3a-b830-efd9d3388e8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:59:02.839740 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43405427-bc51-4d3a-b830-efd9d3388e8f None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:59:02.840018 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43405427-bc51-4d3a-b830-efd9d3388e8f None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:59:02.840291 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43405427-bc51-4d3a-b830-efd9d3388e8f None admin] PATH_INFO: `/v3/projects/2313de78743546e6856f9530fb0460c4` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:59:02.841441 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43405427-bc51-4d3a-b830-efd9d3388e8f None admin] RBAC: Authorizing `identity:get_project(project_id=2313de78743546e6856f9530fb0460c4)` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:59:02.842888 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43405427-bc51-4d3a-b830-efd9d3388e8f None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:59:02.844502 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 420/835] 10.222.0.18 () {56 vars in 1186 bytes} [Thu Oct 13 10:59:02 2022] GET /identity/v3/projects/2313de78743546e6856f9530fb0460c4 => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 13 10:59:02.850864 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43405427-bc51-4d3a-b830-efd9d3388e8f None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:59:02.862654 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db05f1aa-e9e3-412d-91df-c66c470494ec None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:59:02.896371 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64869b9e-288e-4a4b-b6dd-353ad54a4902 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:59:02.897619 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64869b9e-288e-4a4b-b6dd-353ad54a4902 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:59:02.897903 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64869b9e-288e-4a4b-b6dd-353ad54a4902 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:59:02.898177 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64869b9e-288e-4a4b-b6dd-353ad54a4902 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:59:02.904815 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64869b9e-288e-4a4b-b6dd-353ad54a4902 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:59:02.906268 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64869b9e-288e-4a4b-b6dd-353ad54a4902 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:59:02.917998 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application [None req-64869b9e-288e-4a4b-b6dd-353ad54a4902 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 13 10:59:02.917998 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 10:59:02.917998 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 10:59:02.917998 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 10:59:02.917998 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 10:59:02.917998 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 10:59:02.917998 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 10:59:02.917998 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 10:59:02.917998 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 10:59:02.917998 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 10:59:02.917998 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 10:59:02.917998 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 10:59:02.917998 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 13 10:59:02.917998 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 13 10:59:02.917998 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 13 10:59:02.918984 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 13 10:59:02.918984 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 10:59:02.918984 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 10:59:02.918984 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 10:59:02.918984 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 10:59:02.918984 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 10:59:02.918984 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 10:59:02.918984 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 10:59:02.918984 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application with Lock( Oct 13 10:59:02.918984 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 10:59:02.918984 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._enter() Oct 13 10:59:02.918984 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 10:59:02.918984 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 10:59:02.918984 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 10:59:02.918984 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.creator() Oct 13 10:59:02.918984 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 10:59:02.918984 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application created_value = creator( Oct 13 10:59:02.919986 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 13 10:59:02.919986 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 13 10:59:02.919986 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 13 10:59:02.919986 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 13 10:59:02.919986 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 13 10:59:02.919986 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 13 10:59:02.919986 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 13 10:59:02.919986 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application Oct 13 10:59:02.919986 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 416/836] 10.222.0.18 () {56 vars in 1111 bytes} [Thu Oct 13 10:59:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 13 10:59:02.924798 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64869b9e-288e-4a4b-b6dd-353ad54a4902 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:59:02.950637 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43405427-bc51-4d3a-b830-efd9d3388e8f None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:59:02.965193 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:59:02.984413 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1244a8f-356b-44e7-8eb5-3cd2189e3091 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:59:02.985017 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1244a8f-356b-44e7-8eb5-3cd2189e3091 None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:59:02.985308 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1244a8f-356b-44e7-8eb5-3cd2189e3091 None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:59:02.985572 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1244a8f-356b-44e7-8eb5-3cd2189e3091 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:59:02.986282 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1244a8f-356b-44e7-8eb5-3cd2189e3091 None admin] RBAC: Adding query filter params (role.id=30a6d59262144d4d956f4d4207864030, scope.project.id=2313de78743546e6856f9530fb0460c4, user.id=d53da8e068a642e3a18e02bacd14a924) {{(pid=81533) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 10:59:02.986584 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1244a8f-356b-44e7-8eb5-3cd2189e3091 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:59:02.987987 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1244a8f-356b-44e7-8eb5-3cd2189e3091 None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:59:02.993731 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 421/837] 10.222.0.18 () {56 vars in 1374 bytes} [Thu Oct 13 10:59:02 2022] GET /identity/v3/role_assignments?user.id=d53da8e068a642e3a18e02bacd14a924&scope.project.id=2313de78743546e6856f9530fb0460c4&role.id=30a6d59262144d4d956f4d4207864030 => generated 608 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 13 10:59:03.025777 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64869b9e-288e-4a4b-b6dd-353ad54a4902 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:59:03.061460 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22881171-3380-48e7-9762-1c77fb55d833 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:59:03.062070 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22881171-3380-48e7-9762-1c77fb55d833 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:59:03.062345 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22881171-3380-48e7-9762-1c77fb55d833 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:59:03.062614 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22881171-3380-48e7-9762-1c77fb55d833 None admin] PATH_INFO: `/v3/projects` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:59:03.063339 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22881171-3380-48e7-9762-1c77fb55d833 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 10:59:03.063641 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22881171-3380-48e7-9762-1c77fb55d833 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:59:03.065121 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22881171-3380-48e7-9762-1c77fb55d833 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:59:03.078395 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 417/838] 10.222.0.18 () {56 vars in 1148 bytes} [Thu Oct 13 10:59:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 13 10:59:03.085200 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1244a8f-356b-44e7-8eb5-3cd2189e3091 None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:59:03.130459 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:59:03.189708 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1244a8f-356b-44e7-8eb5-3cd2189e3091 None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:59:03.223246 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29e544e-d6fb-48c5-a8f2-55d4d9c9269b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:59:03.223847 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29e544e-d6fb-48c5-a8f2-55d4d9c9269b None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:59:03.224123 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29e544e-d6fb-48c5-a8f2-55d4d9c9269b None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:59:03.224389 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29e544e-d6fb-48c5-a8f2-55d4d9c9269b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:59:03.225681 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29e544e-d6fb-48c5-a8f2-55d4d9c9269b None admin] RBAC: Adding query filter params (role.id=e6e5c2b89fa04f0ca6cb23159febaa30, scope.project.id=112613528384453abe7506465609fbd8, user.id=bc5b13f97c0e4a31940b5b73a916af29) {{(pid=81533) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 10:59:03.225992 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29e544e-d6fb-48c5-a8f2-55d4d9c9269b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:59:03.227402 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29e544e-d6fb-48c5-a8f2-55d4d9c9269b None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:59:03.233055 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 422/839] 10.222.0.18 () {56 vars in 1374 bytes} [Thu Oct 13 10:59:03 2022] GET /identity/v3/role_assignments?user.id=bc5b13f97c0e4a31940b5b73a916af29&scope.project.id=112613528384453abe7506465609fbd8&role.id=e6e5c2b89fa04f0ca6cb23159febaa30 => generated 608 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 10:59:05.167011 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19769693-96a4-4553-a0c2-b3180e59b3c0 None None] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:59:05.167530 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19769693-96a4-4553-a0c2-b3180e59b3c0 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:59:05.167651 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19769693-96a4-4553-a0c2-b3180e59b3c0 None None] PATH_INFO: `/` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:59:05.168890 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 418/840] 10.222.0.18 () {54 vars in 927 bytes} [Thu Oct 13 10:59:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 10:59:05.174133 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d8ffc2-adc3-474f-a76e-7b337d45a01c None None] REQUEST_METHOD: `POST` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:59:05.174568 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d8ffc2-adc3-474f-a76e-7b337d45a01c None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:59:05.174664 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d8ffc2-adc3-474f-a76e-7b337d45a01c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:59:05.192977 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.auth.core [None req-c5d8ffc2-adc3-474f-a76e-7b337d45a01c None None] MFA Rules not processed for user `8ba31ade43694cf8bf28f7528a9ea179`. Rule list: `[]` (Enabled: `True`). {{(pid=81533) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 10:59:05.194822 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-c5d8ffc2-adc3-474f-a76e-7b337d45a01c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 10:59:05.259292 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 423/841] 10.222.0.18 () {58 vars in 1024 bytes} [Thu Oct 13 10:59:05 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 13 10:59:05.527248 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19769693-96a4-4553-a0c2-b3180e59b3c0 None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:59:05.621440 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:59:05.625547 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19769693-96a4-4553-a0c2-b3180e59b3c0 None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:59:05.658824 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f077eafa-5c85-4a08-b0db-59d601594709 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:59:05.659450 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f077eafa-5c85-4a08-b0db-59d601594709 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:59:05.659725 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f077eafa-5c85-4a08-b0db-59d601594709 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:59:05.659989 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f077eafa-5c85-4a08-b0db-59d601594709 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:59:05.661092 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f077eafa-5c85-4a08-b0db-59d601594709 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:59:05.662515 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f077eafa-5c85-4a08-b0db-59d601594709 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:59:05.664033 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 419/842] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Oct 13 10:59:05 2022] GET /identity/v3/domains/default => generated 199 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 10:59:05.669688 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d8ffc2-adc3-474f-a76e-7b337d45a01c None None] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:59:05.703642 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:59:05.767144 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d8ffc2-adc3-474f-a76e-7b337d45a01c None None] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:59:05.800094 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8828c230-9455-44ab-af67-591f4c5570b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:59:05.800625 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8828c230-9455-44ab-af67-591f4c5570b7 None admin] REQUEST_METHOD: `POST` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:59:05.800902 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8828c230-9455-44ab-af67-591f4c5570b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:59:05.801197 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8828c230-9455-44ab-af67-591f4c5570b7 None admin] PATH_INFO: `/v3/users` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:59:05.801841 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8828c230-9455-44ab-af67-591f4c5570b7 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:59:05.803932 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8828c230-9455-44ab-af67-591f4c5570b7 None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:59:05.824431 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 424/843] 10.222.0.18 () {60 vars in 1132 bytes} [Thu Oct 13 10:59:05 2022] POST /identity/v3/users => generated 286 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 13 10:59:07.981943 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721e5264-2125-478d-b14d-d25649d7cf87 None None] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:59:07.982468 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721e5264-2125-478d-b14d-d25649d7cf87 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:59:07.982468 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721e5264-2125-478d-b14d-d25649d7cf87 None None] PATH_INFO: `/` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:59:07.983757 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 420/844] 10.222.0.18 () {54 vars in 927 bytes} [Thu Oct 13 10:59:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 10:59:07.988760 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d51f89-314a-40a6-b9a3-fe626b46e620 None None] REQUEST_METHOD: `POST` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:59:07.989169 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d51f89-314a-40a6-b9a3-fe626b46e620 None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:59:07.989334 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d51f89-314a-40a6-b9a3-fe626b46e620 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:59:08.008111 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.auth.core [None req-49d51f89-314a-40a6-b9a3-fe626b46e620 None None] MFA Rules not processed for user `8ba31ade43694cf8bf28f7528a9ea179`. Rule list: `[]` (Enabled: `True`). {{(pid=81533) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 10:59:08.009305 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-49d51f89-314a-40a6-b9a3-fe626b46e620 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 10:59:08.073784 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 425/845] 10.222.0.18 () {58 vars in 1024 bytes} [Thu Oct 13 10:59:07 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 13 10:59:08.344908 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721e5264-2125-478d-b14d-d25649d7cf87 None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:59:08.443353 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721e5264-2125-478d-b14d-d25649d7cf87 None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:59:08.476973 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af73649-d2c7-4b1b-8933-b2096c2e4e35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:59:08.477617 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af73649-d2c7-4b1b-8933-b2096c2e4e35 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:59:08.477896 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af73649-d2c7-4b1b-8933-b2096c2e4e35 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:59:08.478167 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af73649-d2c7-4b1b-8933-b2096c2e4e35 None admin] PATH_INFO: `/v3/roles/e49be8727cbd4a39b3fbe6925f5af415` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:59:08.479534 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af73649-d2c7-4b1b-8933-b2096c2e4e35 None admin] RBAC: Authorizing `identity:get_role(role_id=e49be8727cbd4a39b3fbe6925f5af415)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:59:08.480893 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af73649-d2c7-4b1b-8933-b2096c2e4e35 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:59:08.482220 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 421/846] 10.222.0.18 () {56 vars in 1177 bytes} [Thu Oct 13 10:59:08 2022] GET /identity/v3/roles/e49be8727cbd4a39b3fbe6925f5af415 => generated 223 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 10:59:08.487960 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d51f89-314a-40a6-b9a3-fe626b46e620 None None] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:59:08.511672 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:59:08.584833 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d51f89-314a-40a6-b9a3-fe626b46e620 None None] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:59:08.618220 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0d4331-a395-468d-acfb-0d5232208a7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:59:08.618777 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0d4331-a395-468d-acfb-0d5232208a7d None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:59:08.619053 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0d4331-a395-468d-acfb-0d5232208a7d None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:59:08.619322 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0d4331-a395-468d-acfb-0d5232208a7d None admin] PATH_INFO: `/v3/users/5aadb347c884429ba3978403f34d79be` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:59:08.632319 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0d4331-a395-468d-acfb-0d5232208a7d None admin] RBAC: Authorizing `identity:get_user(user_id=5aadb347c884429ba3978403f34d79be)` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:59:08.633774 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0d4331-a395-468d-acfb-0d5232208a7d None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:59:08.635345 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 426/847] 10.222.0.18 () {56 vars in 1177 bytes} [Thu Oct 13 10:59:08 2022] GET /identity/v3/users/5aadb347c884429ba3978403f34d79be => generated 286 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 13 10:59:08.641023 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af73649-d2c7-4b1b-8933-b2096c2e4e35 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:59:08.676508 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:59:08.739552 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af73649-d2c7-4b1b-8933-b2096c2e4e35 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:59:08.775562 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65130ff4-50b5-4ba9-857b-4e52d24a4a8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:59:08.776173 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65130ff4-50b5-4ba9-857b-4e52d24a4a8f None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:59:08.776447 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65130ff4-50b5-4ba9-857b-4e52d24a4a8f None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:59:08.776715 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65130ff4-50b5-4ba9-857b-4e52d24a4a8f None admin] PATH_INFO: `/v3/projects/2313de78743546e6856f9530fb0460c4` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:59:08.777837 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65130ff4-50b5-4ba9-857b-4e52d24a4a8f None admin] RBAC: Authorizing `identity:get_project(project_id=2313de78743546e6856f9530fb0460c4)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:59:08.779288 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65130ff4-50b5-4ba9-857b-4e52d24a4a8f None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:59:08.780894 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 422/848] 10.222.0.18 () {56 vars in 1186 bytes} [Thu Oct 13 10:59:08 2022] GET /identity/v3/projects/2313de78743546e6856f9530fb0460c4 => generated 311 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 10:59:08.786982 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0d4331-a395-468d-acfb-0d5232208a7d None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:59:08.865773 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:59:08.884573 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0d4331-a395-468d-acfb-0d5232208a7d None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:59:08.917504 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401356ce-ca44-48c9-a73a-089e63acdb40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:59:08.918142 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401356ce-ca44-48c9-a73a-089e63acdb40 None admin] REQUEST_METHOD: `PUT` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:59:08.918419 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401356ce-ca44-48c9-a73a-089e63acdb40 None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:59:08.918688 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401356ce-ca44-48c9-a73a-089e63acdb40 None admin] PATH_INFO: `/v3/projects/2313de78743546e6856f9530fb0460c4/users/5aadb347c884429ba3978403f34d79be/roles/e49be8727cbd4a39b3fbe6925f5af415` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:59:08.920764 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401356ce-ca44-48c9-a73a-089e63acdb40 None admin] RBAC: Authorizing `identity:create_grant(project_id=2313de78743546e6856f9530fb0460c4, user_id=5aadb347c884429ba3978403f34d79be, role_id=e49be8727cbd4a39b3fbe6925f5af415)` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:59:08.922216 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401356ce-ca44-48c9-a73a-089e63acdb40 None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:59:08.935051 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 427/849] 10.222.0.18 () {58 vars in 1439 bytes} [Thu Oct 13 10:59:08 2022] PUT /identity/v3/projects/2313de78743546e6856f9530fb0460c4/users/5aadb347c884429ba3978403f34d79be/roles/e49be8727cbd4a39b3fbe6925f5af415 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 10:59:11.031903 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bd1103-2544-431e-875d-dd59505a6039 None None] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:59:11.032402 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bd1103-2544-431e-875d-dd59505a6039 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:59:11.032402 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bd1103-2544-431e-875d-dd59505a6039 None None] PATH_INFO: `/` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:59:11.033719 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 423/850] 10.222.0.18 () {54 vars in 927 bytes} [Thu Oct 13 10:59:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 10:59:11.039024 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8fcd52-bb67-4b82-a462-dc69125a19eb None None] REQUEST_METHOD: `POST` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:59:11.039430 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8fcd52-bb67-4b82-a462-dc69125a19eb None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:59:11.039565 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8fcd52-bb67-4b82-a462-dc69125a19eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:59:11.057813 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.auth.core [None req-3e8fcd52-bb67-4b82-a462-dc69125a19eb None None] MFA Rules not processed for user `8ba31ade43694cf8bf28f7528a9ea179`. Rule list: `[]` (Enabled: `True`). {{(pid=81533) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 10:59:11.058991 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-3e8fcd52-bb67-4b82-a462-dc69125a19eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 10:59:11.123090 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 428/851] 10.222.0.18 () {58 vars in 1024 bytes} [Thu Oct 13 10:59:11 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 13 10:59:11.395566 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70bd1103-2544-431e-875d-dd59505a6039 None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:59:11.493695 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70bd1103-2544-431e-875d-dd59505a6039 None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:59:11.495905 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:59:11.526035 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1436520-b368-4808-94d6-dbdd7967fb8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:59:11.526642 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1436520-b368-4808-94d6-dbdd7967fb8b None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:59:11.526917 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1436520-b368-4808-94d6-dbdd7967fb8b None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:59:11.527183 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1436520-b368-4808-94d6-dbdd7967fb8b None admin] PATH_INFO: `/v3/roles/e49be8727cbd4a39b3fbe6925f5af415` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:59:11.528542 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1436520-b368-4808-94d6-dbdd7967fb8b None admin] RBAC: Authorizing `identity:get_role(role_id=e49be8727cbd4a39b3fbe6925f5af415)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:59:11.529918 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1436520-b368-4808-94d6-dbdd7967fb8b None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:59:11.531201 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 424/852] 10.222.0.18 () {56 vars in 1177 bytes} [Thu Oct 13 10:59:11 2022] GET /identity/v3/roles/e49be8727cbd4a39b3fbe6925f5af415 => generated 223 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 10:59:11.537063 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8fcd52-bb67-4b82-a462-dc69125a19eb None None] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:59:11.602825 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:59:11.633530 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8fcd52-bb67-4b82-a462-dc69125a19eb None None] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:59:11.666483 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8fefd67-1382-4e7f-83ff-41a297201b8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:59:11.667087 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fefd67-1382-4e7f-83ff-41a297201b8c None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:59:11.667357 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fefd67-1382-4e7f-83ff-41a297201b8c None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:59:11.667622 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fefd67-1382-4e7f-83ff-41a297201b8c None admin] PATH_INFO: `/v3/users/5aadb347c884429ba3978403f34d79be` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:59:11.668696 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8fefd67-1382-4e7f-83ff-41a297201b8c None admin] RBAC: Authorizing `identity:get_user(user_id=5aadb347c884429ba3978403f34d79be)` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:59:11.670127 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8fefd67-1382-4e7f-83ff-41a297201b8c None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:59:11.671670 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 429/853] 10.222.0.18 () {56 vars in 1177 bytes} [Thu Oct 13 10:59:11 2022] GET /identity/v3/users/5aadb347c884429ba3978403f34d79be => generated 286 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 10:59:11.677440 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1436520-b368-4808-94d6-dbdd7967fb8b None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:59:11.775318 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1436520-b368-4808-94d6-dbdd7967fb8b None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:59:11.807472 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d050a3-efc6-4965-b225-7802236bc810 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:59:11.808067 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d050a3-efc6-4965-b225-7802236bc810 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:59:11.808347 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d050a3-efc6-4965-b225-7802236bc810 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:59:11.808619 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d050a3-efc6-4965-b225-7802236bc810 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:59:11.847449 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:59:11.873711 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d050a3-efc6-4965-b225-7802236bc810 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:59:11.875145 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d050a3-efc6-4965-b225-7802236bc810 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:59:11.969389 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 425/854] 10.222.0.18 () {58 vars in 1282 bytes} [Thu Oct 13 10:59:11 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 13 10:59:11.975252 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8fefd67-1382-4e7f-83ff-41a297201b8c None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:59:12.070528 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8fefd67-1382-4e7f-83ff-41a297201b8c None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:59:12.102119 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766ce352-ac2a-4f5c-8608-d923ec6fc9dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:59:12.102716 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766ce352-ac2a-4f5c-8608-d923ec6fc9dd None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:59:12.102986 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766ce352-ac2a-4f5c-8608-d923ec6fc9dd None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:59:12.103251 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766ce352-ac2a-4f5c-8608-d923ec6fc9dd None admin] PATH_INFO: `/v3/projects/2313de78743546e6856f9530fb0460c4` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:59:12.104331 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766ce352-ac2a-4f5c-8608-d923ec6fc9dd None admin] RBAC: Authorizing `identity:get_project(project_id=2313de78743546e6856f9530fb0460c4)` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:59:12.105752 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766ce352-ac2a-4f5c-8608-d923ec6fc9dd None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:59:12.107318 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 430/855] 10.222.0.18 () {56 vars in 1186 bytes} [Thu Oct 13 10:59:11 2022] GET /identity/v3/projects/2313de78743546e6856f9530fb0460c4 => generated 311 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 10:59:12.113722 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d050a3-efc6-4965-b225-7802236bc810 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:59:12.181469 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:59:12.210775 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d050a3-efc6-4965-b225-7802236bc810 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:59:12.243099 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf294986-81d7-4257-ad49-a37a96a74cba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:59:12.243634 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf294986-81d7-4257-ad49-a37a96a74cba None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:59:12.243914 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf294986-81d7-4257-ad49-a37a96a74cba None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:59:12.244186 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf294986-81d7-4257-ad49-a37a96a74cba None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:59:12.244901 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf294986-81d7-4257-ad49-a37a96a74cba None admin] RBAC: Adding query filter params (role.id=e49be8727cbd4a39b3fbe6925f5af415, scope.project.id=2313de78743546e6856f9530fb0460c4, user.id=5aadb347c884429ba3978403f34d79be) {{(pid=81534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 10:59:12.245240 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf294986-81d7-4257-ad49-a37a96a74cba None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:59:12.246674 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf294986-81d7-4257-ad49-a37a96a74cba None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:59:12.252185 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 426/856] 10.222.0.18 () {56 vars in 1374 bytes} [Thu Oct 13 10:59:12 2022] GET /identity/v3/role_assignments?user.id=5aadb347c884429ba3978403f34d79be&scope.project.id=2313de78743546e6856f9530fb0460c4&role.id=e49be8727cbd4a39b3fbe6925f5af415 => generated 608 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 10:59:14.384747 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02792145-9457-4ae4-a502-535b88182126 None None] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:59:14.385363 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02792145-9457-4ae4-a502-535b88182126 None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:59:14.385363 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02792145-9457-4ae4-a502-535b88182126 None None] PATH_INFO: `/` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:59:14.386677 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 431/857] 10.222.0.18 () {54 vars in 927 bytes} [Thu Oct 13 10:59:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 10:59:14.392038 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70262bef-2322-42be-b30f-16e13d3cfa04 None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:59:14.392432 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70262bef-2322-42be-b30f-16e13d3cfa04 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:59:14.392574 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70262bef-2322-42be-b30f-16e13d3cfa04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:59:14.410791 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-70262bef-2322-42be-b30f-16e13d3cfa04 None None] MFA Rules not processed for user `8ba31ade43694cf8bf28f7528a9ea179`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 10:59:14.411948 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-70262bef-2322-42be-b30f-16e13d3cfa04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 10:59:14.476641 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 427/858] 10.222.0.18 () {58 vars in 1024 bytes} [Thu Oct 13 10:59:14 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 13 10:59:14.746951 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02792145-9457-4ae4-a502-535b88182126 None None] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:59:14.755855 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:59:14.846674 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02792145-9457-4ae4-a502-535b88182126 None None] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:59:14.880490 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b9a603-179f-4fcf-a788-ca7f8bc001c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:59:14.881807 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b9a603-179f-4fcf-a788-ca7f8bc001c2 None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:59:14.882506 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b9a603-179f-4fcf-a788-ca7f8bc001c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:59:14.882861 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b9a603-179f-4fcf-a788-ca7f8bc001c2 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:59:14.883956 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b9a603-179f-4fcf-a788-ca7f8bc001c2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:59:14.885383 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b9a603-179f-4fcf-a788-ca7f8bc001c2 None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:59:14.886921 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 432/859] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Oct 13 10:59:14 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 10:59:14.892723 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70262bef-2322-42be-b30f-16e13d3cfa04 None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:59:14.954948 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:59:14.987302 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70262bef-2322-42be-b30f-16e13d3cfa04 None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:59:15.020226 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd5a50f-3b22-45cd-afcf-4f390265caae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:59:15.020810 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd5a50f-3b22-45cd-afcf-4f390265caae None admin] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:59:15.021113 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd5a50f-3b22-45cd-afcf-4f390265caae None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:59:15.021381 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd5a50f-3b22-45cd-afcf-4f390265caae None admin] PATH_INFO: `/v3/projects` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:59:15.022055 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd5a50f-3b22-45cd-afcf-4f390265caae None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:59:15.023455 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd5a50f-3b22-45cd-afcf-4f390265caae None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:59:15.048086 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 428/860] 10.222.0.18 () {60 vars in 1141 bytes} [Thu Oct 13 10:59:14 2022] POST /identity/v3/projects => generated 311 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 13 10:59:17.202718 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e37f85-1c51-4177-9c13-aa28d0330f62 None None] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:59:17.203259 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e37f85-1c51-4177-9c13-aa28d0330f62 None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:59:17.203259 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e37f85-1c51-4177-9c13-aa28d0330f62 None None] PATH_INFO: `/` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:59:17.204596 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 433/861] 10.222.0.18 () {54 vars in 927 bytes} [Thu Oct 13 10:59:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 10:59:17.210223 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe39613-39e2-4c23-b496-2a2ed663d38f None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:59:17.210682 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe39613-39e2-4c23-b496-2a2ed663d38f None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:59:17.210785 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe39613-39e2-4c23-b496-2a2ed663d38f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:59:17.229051 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-abe39613-39e2-4c23-b496-2a2ed663d38f None None] MFA Rules not processed for user `8ba31ade43694cf8bf28f7528a9ea179`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 10:59:17.230215 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-abe39613-39e2-4c23-b496-2a2ed663d38f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 10:59:17.293517 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 429/862] 10.222.0.18 () {58 vars in 1024 bytes} [Thu Oct 13 10:59:17 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 13 10:59:17.566915 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e37f85-1c51-4177-9c13-aa28d0330f62 None None] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:59:17.640981 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:59:17.666909 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e37f85-1c51-4177-9c13-aa28d0330f62 None None] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:59:17.699509 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c214bfac-bafc-4f0f-885c-d80133f8aa2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:59:17.700111 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c214bfac-bafc-4f0f-885c-d80133f8aa2a None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:59:17.700382 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c214bfac-bafc-4f0f-885c-d80133f8aa2a None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:59:17.700646 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c214bfac-bafc-4f0f-885c-d80133f8aa2a None admin] PATH_INFO: `/v3/domains/default` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:59:17.701749 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c214bfac-bafc-4f0f-885c-d80133f8aa2a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:59:17.703156 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c214bfac-bafc-4f0f-885c-d80133f8aa2a None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:59:17.704669 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 434/863] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Oct 13 10:59:17 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 10:59:17.711175 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe39613-39e2-4c23-b496-2a2ed663d38f None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:59:17.758381 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:59:17.809736 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe39613-39e2-4c23-b496-2a2ed663d38f None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:59:17.842499 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a879ce-c78f-47a5-a78d-316ac62813c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:59:17.843041 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a879ce-c78f-47a5-a78d-316ac62813c0 None admin] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:59:17.843320 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a879ce-c78f-47a5-a78d-316ac62813c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:59:17.843590 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a879ce-c78f-47a5-a78d-316ac62813c0 None admin] PATH_INFO: `/v3/users` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:59:17.844245 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a879ce-c78f-47a5-a78d-316ac62813c0 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:59:17.845700 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a879ce-c78f-47a5-a78d-316ac62813c0 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:59:17.866717 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 430/864] 10.222.0.18 () {60 vars in 1132 bytes} [Thu Oct 13 10:59:17 2022] POST /identity/v3/users => generated 286 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 13 10:59:20.012602 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd76dcc-07ff-4c7b-8507-1878851ffeb5 None None] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:59:20.013185 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd76dcc-07ff-4c7b-8507-1878851ffeb5 None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:59:20.013185 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd76dcc-07ff-4c7b-8507-1878851ffeb5 None None] PATH_INFO: `/` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:59:20.014409 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 435/865] 10.222.0.18 () {54 vars in 927 bytes} [Thu Oct 13 10:59:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 10:59:20.019461 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5873b289-3fe4-4578-a4c2-1661dbcfbdc4 None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:59:20.019881 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5873b289-3fe4-4578-a4c2-1661dbcfbdc4 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:59:20.020008 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5873b289-3fe4-4578-a4c2-1661dbcfbdc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:59:20.038288 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-5873b289-3fe4-4578-a4c2-1661dbcfbdc4 None None] MFA Rules not processed for user `8ba31ade43694cf8bf28f7528a9ea179`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 10:59:20.039457 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-5873b289-3fe4-4578-a4c2-1661dbcfbdc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 10:59:20.102971 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 431/866] 10.222.0.18 () {58 vars in 1024 bytes} [Thu Oct 13 10:59:20 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 13 10:59:20.373117 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd76dcc-07ff-4c7b-8507-1878851ffeb5 None None] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:59:20.471292 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd76dcc-07ff-4c7b-8507-1878851ffeb5 None None] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:59:20.504517 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b5c061-4924-4907-80f9-bd83df073c4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:59:20.505140 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b5c061-4924-4907-80f9-bd83df073c4b None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:59:20.505415 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b5c061-4924-4907-80f9-bd83df073c4b None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:59:20.505680 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b5c061-4924-4907-80f9-bd83df073c4b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:59:20.515724 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b5c061-4924-4907-80f9-bd83df073c4b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 13 10:59:20.520419 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application [None req-14b5c061-4924-4907-80f9-bd83df073c4b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 13 10:59:20.520419 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 10:59:20.520419 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 10:59:20.520419 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 10:59:20.520419 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 10:59:20.520419 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 10:59:20.520419 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 10:59:20.520419 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 10:59:20.520419 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 10:59:20.520419 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 10:59:20.520419 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 10:59:20.520419 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 10:59:20.520419 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 13 10:59:20.520419 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 13 10:59:20.520419 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 13 10:59:20.520419 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 13 10:59:20.521625 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 13 10:59:20.521625 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 13 10:59:20.521625 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 13 10:59:20.521625 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 13 10:59:20.521625 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 10:59:20.521625 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 10:59:20.521625 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 10:59:20.521625 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 10:59:20.521625 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 10:59:20.521625 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 10:59:20.521625 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 10:59:20.521625 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application with Lock( Oct 13 10:59:20.521625 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 10:59:20.521625 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._enter() Oct 13 10:59:20.521625 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 10:59:20.521625 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 10:59:20.522888 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 10:59:20.522888 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.creator() Oct 13 10:59:20.522888 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 10:59:20.522888 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application created_value = creator( Oct 13 10:59:20.522888 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 13 10:59:20.522888 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 13 10:59:20.522888 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 13 10:59:20.522888 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 13 10:59:20.522888 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 13 10:59:20.522888 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 13 10:59:20.522888 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 13 10:59:20.522888 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application Oct 13 10:59:20.522888 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 436/867] 10.222.0.18 () {56 vars in 1096 bytes} [Thu Oct 13 10:59:20 2022] GET /identity/v3/roles/admin => generated 83 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 10:59:20.527805 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5873b289-3fe4-4578-a4c2-1661dbcfbdc4 None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:59:20.560965 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:59:20.624762 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5873b289-3fe4-4578-a4c2-1661dbcfbdc4 None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:59:20.656945 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b56f09-ea0b-4e73-ac0a-e517545f163e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:59:20.657557 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b56f09-ea0b-4e73-ac0a-e517545f163e None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:59:20.657834 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b56f09-ea0b-4e73-ac0a-e517545f163e None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:59:20.658102 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b56f09-ea0b-4e73-ac0a-e517545f163e None admin] PATH_INFO: `/v3/roles` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:59:20.658758 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b56f09-ea0b-4e73-ac0a-e517545f163e None admin] RBAC: Adding query filter params (name=admin) {{(pid=81534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 10:59:20.659057 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b56f09-ea0b-4e73-ac0a-e517545f163e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:59:20.660402 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b56f09-ea0b-4e73-ac0a-e517545f163e None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:59:20.668642 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 432/868] 10.222.0.18 () {56 vars in 1099 bytes} [Thu Oct 13 10:59:20 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 10:59:20.674384 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b5c061-4924-4907-80f9-bd83df073c4b None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:59:20.677769 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:59:20.773216 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b5c061-4924-4907-80f9-bd83df073c4b None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:59:20.806500 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf5ba64-d29f-483c-874a-552b4d90bb90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:59:20.807121 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf5ba64-d29f-483c-874a-552b4d90bb90 None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:59:20.807398 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf5ba64-d29f-483c-874a-552b4d90bb90 None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:59:20.807671 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf5ba64-d29f-483c-874a-552b4d90bb90 None admin] PATH_INFO: `/v3/users/404aae06ce4b486e9afbc4e0493a8838` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:59:20.820398 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf5ba64-d29f-483c-874a-552b4d90bb90 None admin] RBAC: Authorizing `identity:get_user(user_id=404aae06ce4b486e9afbc4e0493a8838)` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:59:20.821866 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf5ba64-d29f-483c-874a-552b4d90bb90 None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:59:20.823441 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 437/869] 10.222.0.18 () {56 vars in 1177 bytes} [Thu Oct 13 10:59:20 2022] GET /identity/v3/users/404aae06ce4b486e9afbc4e0493a8838 => generated 286 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 10:59:20.829379 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b56f09-ea0b-4e73-ac0a-e517545f163e None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:59:20.921136 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:59:20.927217 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b56f09-ea0b-4e73-ac0a-e517545f163e None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:59:20.960081 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0b4681-70a7-41f9-b5c6-82cba6bf49f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:59:20.960711 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0b4681-70a7-41f9-b5c6-82cba6bf49f6 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:59:20.960987 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0b4681-70a7-41f9-b5c6-82cba6bf49f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:59:20.961289 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0b4681-70a7-41f9-b5c6-82cba6bf49f6 None admin] PATH_INFO: `/v3/projects/18b0641025c9474bb6b75fc788ab58bc` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:59:20.962392 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0b4681-70a7-41f9-b5c6-82cba6bf49f6 None admin] RBAC: Authorizing `identity:get_project(project_id=18b0641025c9474bb6b75fc788ab58bc)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:59:20.963800 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0b4681-70a7-41f9-b5c6-82cba6bf49f6 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:59:20.965437 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 433/870] 10.222.0.18 () {56 vars in 1186 bytes} [Thu Oct 13 10:59:20 2022] GET /identity/v3/projects/18b0641025c9474bb6b75fc788ab58bc => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 10:59:20.971303 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf5ba64-d29f-483c-874a-552b4d90bb90 None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:59:21.028935 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:59:21.067717 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf5ba64-d29f-483c-874a-552b4d90bb90 None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:59:21.100364 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4c80e0-fa95-4596-a412-67f046eecf85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:59:21.101025 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4c80e0-fa95-4596-a412-67f046eecf85 None admin] REQUEST_METHOD: `PUT` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:59:21.101304 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4c80e0-fa95-4596-a412-67f046eecf85 None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:59:21.101573 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4c80e0-fa95-4596-a412-67f046eecf85 None admin] PATH_INFO: `/v3/projects/18b0641025c9474bb6b75fc788ab58bc/users/404aae06ce4b486e9afbc4e0493a8838/roles/30a6d59262144d4d956f4d4207864030` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:59:21.103406 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4c80e0-fa95-4596-a412-67f046eecf85 None admin] RBAC: Authorizing `identity:create_grant(project_id=18b0641025c9474bb6b75fc788ab58bc, user_id=404aae06ce4b486e9afbc4e0493a8838, role_id=30a6d59262144d4d956f4d4207864030)` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:59:21.104813 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4c80e0-fa95-4596-a412-67f046eecf85 None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:59:21.117433 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 438/871] 10.222.0.18 () {58 vars in 1439 bytes} [Thu Oct 13 10:59:20 2022] PUT /identity/v3/projects/18b0641025c9474bb6b75fc788ab58bc/users/404aae06ce4b486e9afbc4e0493a8838/roles/30a6d59262144d4d956f4d4207864030 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 10:59:23.225467 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395cb901-c506-4553-bc38-c923e9549462 None None] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:59:23.225993 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395cb901-c506-4553-bc38-c923e9549462 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:59:23.225993 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395cb901-c506-4553-bc38-c923e9549462 None None] PATH_INFO: `/` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:59:23.227322 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 434/872] 10.222.0.18 () {54 vars in 927 bytes} [Thu Oct 13 10:59:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 10:59:23.232443 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b18f664-4d7d-44fc-8bff-203367692936 None None] REQUEST_METHOD: `POST` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:59:23.232840 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b18f664-4d7d-44fc-8bff-203367692936 None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:59:23.232986 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b18f664-4d7d-44fc-8bff-203367692936 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:59:23.251474 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.auth.core [None req-8b18f664-4d7d-44fc-8bff-203367692936 None None] MFA Rules not processed for user `8ba31ade43694cf8bf28f7528a9ea179`. Rule list: `[]` (Enabled: `True`). {{(pid=81533) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 10:59:23.252638 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-8b18f664-4d7d-44fc-8bff-203367692936 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 10:59:23.316452 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 439/873] 10.222.0.18 () {58 vars in 1024 bytes} [Thu Oct 13 10:59:23 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 13 10:59:23.582282 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395cb901-c506-4553-bc38-c923e9549462 None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:59:23.680094 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395cb901-c506-4553-bc38-c923e9549462 None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:59:23.711522 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50f1623-cc49-4a57-81bc-c6101cc166d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:59:23.712123 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50f1623-cc49-4a57-81bc-c6101cc166d3 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:59:23.712398 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50f1623-cc49-4a57-81bc-c6101cc166d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:59:23.712667 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50f1623-cc49-4a57-81bc-c6101cc166d3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:59:23.722267 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50f1623-cc49-4a57-81bc-c6101cc166d3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 13 10:59:23.727562 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application [None req-c50f1623-cc49-4a57-81bc-c6101cc166d3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 13 10:59:23.727562 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 10:59:23.727562 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 10:59:23.727562 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 10:59:23.727562 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 10:59:23.727562 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 10:59:23.727562 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 10:59:23.727562 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 10:59:23.727562 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 10:59:23.727562 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 10:59:23.727562 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 10:59:23.727562 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 10:59:23.727562 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 13 10:59:23.727562 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 13 10:59:23.727562 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 13 10:59:23.727562 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 13 10:59:23.728536 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 13 10:59:23.728536 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 13 10:59:23.728536 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 13 10:59:23.728536 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 13 10:59:23.728536 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 10:59:23.728536 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 10:59:23.728536 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 10:59:23.728536 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 10:59:23.728536 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 10:59:23.728536 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 10:59:23.728536 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 10:59:23.728536 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application with Lock( Oct 13 10:59:23.728536 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 10:59:23.728536 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._enter() Oct 13 10:59:23.728536 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 10:59:23.728536 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 10:59:23.729554 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 10:59:23.729554 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.creator() Oct 13 10:59:23.729554 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 10:59:23.729554 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application created_value = creator( Oct 13 10:59:23.729554 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 13 10:59:23.729554 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 13 10:59:23.729554 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 13 10:59:23.729554 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 13 10:59:23.729554 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 13 10:59:23.729554 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 13 10:59:23.729554 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 13 10:59:23.729554 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application Oct 13 10:59:23.729554 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 435/874] 10.222.0.18 () {56 vars in 1096 bytes} [Thu Oct 13 10:59:23 2022] GET /identity/v3/roles/admin => generated 83 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 10:59:23.734663 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b18f664-4d7d-44fc-8bff-203367692936 None None] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:59:23.782656 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:59:23.830790 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b18f664-4d7d-44fc-8bff-203367692936 None None] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:59:23.864102 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7175dfa2-4000-4924-b1d5-cb43945ad493 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:59:23.864632 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7175dfa2-4000-4924-b1d5-cb43945ad493 None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:59:23.864906 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7175dfa2-4000-4924-b1d5-cb43945ad493 None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:59:23.865202 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7175dfa2-4000-4924-b1d5-cb43945ad493 None admin] PATH_INFO: `/v3/roles` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:59:23.866041 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7175dfa2-4000-4924-b1d5-cb43945ad493 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81533) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 10:59:23.866337 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7175dfa2-4000-4924-b1d5-cb43945ad493 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:59:23.867681 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7175dfa2-4000-4924-b1d5-cb43945ad493 None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:59:23.875340 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 440/875] 10.222.0.18 () {56 vars in 1099 bytes} [Thu Oct 13 10:59:23 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 10:59:23.881390 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50f1623-cc49-4a57-81bc-c6101cc166d3 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:59:23.906864 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:59:23.979231 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50f1623-cc49-4a57-81bc-c6101cc166d3 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:59:24.011440 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd0ff5a-79e4-45e5-840e-01fea37a5d5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:59:24.012053 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd0ff5a-79e4-45e5-840e-01fea37a5d5a None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:59:24.012331 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd0ff5a-79e4-45e5-840e-01fea37a5d5a None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:59:24.012607 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd0ff5a-79e4-45e5-840e-01fea37a5d5a None admin] PATH_INFO: `/v3/users/404aae06ce4b486e9afbc4e0493a8838` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:59:24.013724 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd0ff5a-79e4-45e5-840e-01fea37a5d5a None admin] RBAC: Authorizing `identity:get_user(user_id=404aae06ce4b486e9afbc4e0493a8838)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:59:24.015144 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd0ff5a-79e4-45e5-840e-01fea37a5d5a None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:59:24.016690 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 436/876] 10.222.0.18 () {56 vars in 1177 bytes} [Thu Oct 13 10:59:23 2022] GET /identity/v3/users/404aae06ce4b486e9afbc4e0493a8838 => generated 286 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 10:59:24.023247 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7175dfa2-4000-4924-b1d5-cb43945ad493 None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:59:24.119824 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7175dfa2-4000-4924-b1d5-cb43945ad493 None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:59:24.132105 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:59:24.153350 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e70507-c0ac-4375-bf2a-fb230a805c2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:59:24.153936 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e70507-c0ac-4375-bf2a-fb230a805c2b None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:59:24.154210 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e70507-c0ac-4375-bf2a-fb230a805c2b None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:59:24.154477 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e70507-c0ac-4375-bf2a-fb230a805c2b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:59:24.219417 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e70507-c0ac-4375-bf2a-fb230a805c2b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:59:24.220843 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e70507-c0ac-4375-bf2a-fb230a805c2b None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:59:24.315233 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 441/877] 10.222.0.18 () {58 vars in 1282 bytes} [Thu Oct 13 10:59:24 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 13 10:59:24.321783 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd0ff5a-79e4-45e5-840e-01fea37a5d5a None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:59:24.411444 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:59:24.420358 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd0ff5a-79e4-45e5-840e-01fea37a5d5a None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:59:24.452865 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae390770-9f1d-4ba0-891e-c65bdfc455a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:59:24.453502 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae390770-9f1d-4ba0-891e-c65bdfc455a9 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:59:24.453783 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae390770-9f1d-4ba0-891e-c65bdfc455a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:59:24.454055 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae390770-9f1d-4ba0-891e-c65bdfc455a9 None admin] PATH_INFO: `/v3/projects/18b0641025c9474bb6b75fc788ab58bc` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:59:24.455158 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae390770-9f1d-4ba0-891e-c65bdfc455a9 None admin] RBAC: Authorizing `identity:get_project(project_id=18b0641025c9474bb6b75fc788ab58bc)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:59:24.456574 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae390770-9f1d-4ba0-891e-c65bdfc455a9 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:59:24.458209 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 437/878] 10.222.0.18 () {56 vars in 1186 bytes} [Thu Oct 13 10:59:24 2022] GET /identity/v3/projects/18b0641025c9474bb6b75fc788ab58bc => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 10:59:24.464811 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e70507-c0ac-4375-bf2a-fb230a805c2b None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:59:24.478323 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:59:24.560995 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e70507-c0ac-4375-bf2a-fb230a805c2b None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:59:24.593830 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ffc4f9-f601-4daf-8584-8fccae97e6fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:59:24.594417 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ffc4f9-f601-4daf-8584-8fccae97e6fa None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:59:24.594692 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ffc4f9-f601-4daf-8584-8fccae97e6fa None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:59:24.594960 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ffc4f9-f601-4daf-8584-8fccae97e6fa None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:59:24.595665 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ffc4f9-f601-4daf-8584-8fccae97e6fa None admin] RBAC: Adding query filter params (role.id=30a6d59262144d4d956f4d4207864030, scope.project.id=18b0641025c9474bb6b75fc788ab58bc, user.id=404aae06ce4b486e9afbc4e0493a8838) {{(pid=81533) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 10:59:24.595966 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ffc4f9-f601-4daf-8584-8fccae97e6fa None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:59:24.597408 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ffc4f9-f601-4daf-8584-8fccae97e6fa None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:59:24.603259 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 442/879] 10.222.0.18 () {56 vars in 1374 bytes} [Thu Oct 13 10:59:24 2022] GET /identity/v3/role_assignments?user.id=404aae06ce4b486e9afbc4e0493a8838&scope.project.id=18b0641025c9474bb6b75fc788ab58bc&role.id=30a6d59262144d4d956f4d4207864030 => generated 608 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 10:59:26.739975 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b45b43-0a91-45c1-b149-545fb4ce4c44 None None] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:59:26.740458 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b45b43-0a91-45c1-b149-545fb4ce4c44 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:59:26.740644 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b45b43-0a91-45c1-b149-545fb4ce4c44 None None] PATH_INFO: `/` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:59:26.742456 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 438/880] 10.222.0.18 () {54 vars in 927 bytes} [Thu Oct 13 10:59:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 10:59:26.747740 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ff6507-3597-4c6f-9f00-460cf00fe4fe None None] REQUEST_METHOD: `POST` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:59:26.748154 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ff6507-3597-4c6f-9f00-460cf00fe4fe None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:59:26.748262 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ff6507-3597-4c6f-9f00-460cf00fe4fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:59:26.766477 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.auth.core [None req-92ff6507-3597-4c6f-9f00-460cf00fe4fe None None] MFA Rules not processed for user `8ba31ade43694cf8bf28f7528a9ea179`. Rule list: `[]` (Enabled: `True`). {{(pid=81533) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 10:59:26.767637 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-92ff6507-3597-4c6f-9f00-460cf00fe4fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 10:59:26.832338 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 443/881] 10.222.0.18 () {58 vars in 1024 bytes} [Thu Oct 13 10:59:26 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 13 10:59:27.105462 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b45b43-0a91-45c1-b149-545fb4ce4c44 None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:59:27.204271 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b45b43-0a91-45c1-b149-545fb4ce4c44 None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:59:27.236956 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b244ca3c-56bf-4712-ae88-72c012334927 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:59:27.237570 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b244ca3c-56bf-4712-ae88-72c012334927 None admin] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:59:27.237846 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b244ca3c-56bf-4712-ae88-72c012334927 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:59:27.238117 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b244ca3c-56bf-4712-ae88-72c012334927 None admin] PATH_INFO: `/v3/domains` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:59:27.238784 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b244ca3c-56bf-4712-ae88-72c012334927 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:59:27.240126 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b244ca3c-56bf-4712-ae88-72c012334927 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:59:27.255602 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 439/882] 10.222.0.18 () {60 vars in 1138 bytes} [Thu Oct 13 10:59:27 2022] POST /identity/v3/domains => generated 267 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 13 10:59:29.396143 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0facbc-1018-4c2c-8d03-f901baa3aff4 None None] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:59:29.397315 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0facbc-1018-4c2c-8d03-f901baa3aff4 None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:59:29.397799 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0facbc-1018-4c2c-8d03-f901baa3aff4 None None] PATH_INFO: `/` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:59:29.399156 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 444/883] 10.222.0.18 () {54 vars in 927 bytes} [Thu Oct 13 10:59:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 10:59:29.404302 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9643e424-dfe8-4f2e-8bc5-977ec9656113 None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:59:29.404686 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9643e424-dfe8-4f2e-8bc5-977ec9656113 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:59:29.404846 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9643e424-dfe8-4f2e-8bc5-977ec9656113 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:59:29.422486 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-9643e424-dfe8-4f2e-8bc5-977ec9656113 None None] MFA Rules not processed for user `8ba31ade43694cf8bf28f7528a9ea179`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 10:59:29.423658 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-9643e424-dfe8-4f2e-8bc5-977ec9656113 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 10:59:29.439396 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:59:29.491746 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 440/884] 10.222.0.18 () {58 vars in 1024 bytes} [Thu Oct 13 10:59:29 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 13 10:59:29.759248 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0facbc-1018-4c2c-8d03-f901baa3aff4 None None] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:59:29.768054 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:59:29.859330 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0facbc-1018-4c2c-8d03-f901baa3aff4 None None] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:59:29.891403 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ca1533-526d-40be-8fa6-7c7782bbb4be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:59:29.892017 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ca1533-526d-40be-8fa6-7c7782bbb4be None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:59:29.892291 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ca1533-526d-40be-8fa6-7c7782bbb4be None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:59:29.892560 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ca1533-526d-40be-8fa6-7c7782bbb4be None admin] PATH_INFO: `/v3/domains/c0b683bc8e6a4054bd01c0c6e282897c` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:59:29.903136 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ca1533-526d-40be-8fa6-7c7782bbb4be None admin] RBAC: Authorizing `identity:get_domain(domain_id=c0b683bc8e6a4054bd01c0c6e282897c)` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:59:29.904559 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ca1533-526d-40be-8fa6-7c7782bbb4be None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:59:29.906151 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 445/885] 10.222.0.18 () {56 vars in 1183 bytes} [Thu Oct 13 10:59:29 2022] GET /identity/v3/domains/c0b683bc8e6a4054bd01c0c6e282897c => generated 267 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 10:59:29.911957 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9643e424-dfe8-4f2e-8bc5-977ec9656113 None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:59:30.006846 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9643e424-dfe8-4f2e-8bc5-977ec9656113 None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:59:30.039913 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd89cc7c-6480-4789-a176-16d39d209d70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:59:30.040499 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd89cc7c-6480-4789-a176-16d39d209d70 None admin] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:59:30.040773 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd89cc7c-6480-4789-a176-16d39d209d70 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:59:30.041074 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd89cc7c-6480-4789-a176-16d39d209d70 None admin] PATH_INFO: `/v3/projects` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:59:30.041752 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd89cc7c-6480-4789-a176-16d39d209d70 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:59:30.043156 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd89cc7c-6480-4789-a176-16d39d209d70 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:59:30.068982 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 441/886] 10.222.0.18 () {60 vars in 1141 bytes} [Thu Oct 13 10:59:29 2022] POST /identity/v3/projects => generated 361 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 13 10:59:32.220271 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed08747-b6bd-4eb7-b354-15bf558b5c1c None None] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:59:32.220815 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed08747-b6bd-4eb7-b354-15bf558b5c1c None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:59:32.220815 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed08747-b6bd-4eb7-b354-15bf558b5c1c None None] PATH_INFO: `/` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:59:32.222176 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 446/887] 10.222.0.18 () {54 vars in 927 bytes} [Thu Oct 13 10:59:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 10:59:32.227839 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b294095c-609d-4561-ad86-c4ec645c4990 None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:59:32.228284 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b294095c-609d-4561-ad86-c4ec645c4990 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:59:32.228385 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b294095c-609d-4561-ad86-c4ec645c4990 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:59:32.234634 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:59:32.248202 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-b294095c-609d-4561-ad86-c4ec645c4990 None None] MFA Rules not processed for user `8ba31ade43694cf8bf28f7528a9ea179`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 10:59:32.249408 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-b294095c-609d-4561-ad86-c4ec645c4990 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 10:59:32.313604 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 442/888] 10.222.0.18 () {58 vars in 1024 bytes} [Thu Oct 13 10:59:32 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 13 10:59:32.589540 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed08747-b6bd-4eb7-b354-15bf558b5c1c None None] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:59:32.654651 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:59:32.690046 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed08747-b6bd-4eb7-b354-15bf558b5c1c None None] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:59:32.721900 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca2b01d-1592-4a2f-bfbe-ff16b58d6983 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:59:32.722509 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca2b01d-1592-4a2f-bfbe-ff16b58d6983 None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:59:32.722779 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca2b01d-1592-4a2f-bfbe-ff16b58d6983 None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:59:32.723043 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca2b01d-1592-4a2f-bfbe-ff16b58d6983 None admin] PATH_INFO: `/v3/domains/c0b683bc8e6a4054bd01c0c6e282897c` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:59:32.724124 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca2b01d-1592-4a2f-bfbe-ff16b58d6983 None admin] RBAC: Authorizing `identity:get_domain(domain_id=c0b683bc8e6a4054bd01c0c6e282897c)` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:59:32.726094 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca2b01d-1592-4a2f-bfbe-ff16b58d6983 None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:59:32.727653 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 447/889] 10.222.0.18 () {56 vars in 1183 bytes} [Thu Oct 13 10:59:32 2022] GET /identity/v3/domains/c0b683bc8e6a4054bd01c0c6e282897c => generated 267 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 10:59:32.733514 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b294095c-609d-4561-ad86-c4ec645c4990 None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:59:32.829095 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b294095c-609d-4561-ad86-c4ec645c4990 None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:59:32.857530 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:59:32.862401 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8562be-2bf6-4b94-9f89-e005ff5cd8e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:59:32.862991 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8562be-2bf6-4b94-9f89-e005ff5cd8e2 None admin] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:59:32.863264 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8562be-2bf6-4b94-9f89-e005ff5cd8e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:59:32.863530 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8562be-2bf6-4b94-9f89-e005ff5cd8e2 None admin] PATH_INFO: `/v3/users` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:59:32.864182 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8562be-2bf6-4b94-9f89-e005ff5cd8e2 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:59:32.866179 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8562be-2bf6-4b94-9f89-e005ff5cd8e2 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:59:32.887236 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 443/890] 10.222.0.18 () {60 vars in 1132 bytes} [Thu Oct 13 10:59:32 2022] POST /identity/v3/users => generated 311 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 13 10:59:35.062547 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c3bad3-cea0-4171-9207-a51bd7482291 None None] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:59:35.063084 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c3bad3-cea0-4171-9207-a51bd7482291 None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:59:35.063084 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c3bad3-cea0-4171-9207-a51bd7482291 None None] PATH_INFO: `/` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:59:35.064325 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 448/891] 10.222.0.18 () {54 vars in 927 bytes} [Thu Oct 13 10:59:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 10:59:35.069539 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6427a58-62a7-48b8-a306-6bdb96a7af16 None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:59:35.069964 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6427a58-62a7-48b8-a306-6bdb96a7af16 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:59:35.070093 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6427a58-62a7-48b8-a306-6bdb96a7af16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:59:35.088326 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-a6427a58-62a7-48b8-a306-6bdb96a7af16 None None] MFA Rules not processed for user `8ba31ade43694cf8bf28f7528a9ea179`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 10:59:35.089541 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-a6427a58-62a7-48b8-a306-6bdb96a7af16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 10:59:35.153768 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 444/892] 10.222.0.18 () {58 vars in 1024 bytes} [Thu Oct 13 10:59:35 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 13 10:59:35.419399 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c3bad3-cea0-4171-9207-a51bd7482291 None None] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:59:35.520295 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c3bad3-cea0-4171-9207-a51bd7482291 None None] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:59:35.552950 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6cc7150-e7e7-4292-93df-ece31627d46c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:59:35.553751 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cc7150-e7e7-4292-93df-ece31627d46c None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:59:35.554022 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cc7150-e7e7-4292-93df-ece31627d46c None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:59:35.554284 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cc7150-e7e7-4292-93df-ece31627d46c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:59:35.556037 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:59:35.564793 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6cc7150-e7e7-4292-93df-ece31627d46c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 13 10:59:35.570167 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application [None req-a6cc7150-e7e7-4292-93df-ece31627d46c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 13 10:59:35.570167 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 10:59:35.570167 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 10:59:35.570167 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 10:59:35.570167 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 10:59:35.570167 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 10:59:35.570167 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 10:59:35.570167 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 10:59:35.570167 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 10:59:35.570167 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 10:59:35.570167 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 10:59:35.570167 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 10:59:35.570167 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 13 10:59:35.570167 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 13 10:59:35.570167 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 13 10:59:35.570167 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 13 10:59:35.571369 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 13 10:59:35.571369 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 13 10:59:35.571369 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 13 10:59:35.571369 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 13 10:59:35.571369 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 10:59:35.571369 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 10:59:35.571369 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 10:59:35.571369 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 10:59:35.571369 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 10:59:35.571369 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 10:59:35.571369 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 10:59:35.571369 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application with Lock( Oct 13 10:59:35.571369 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 10:59:35.571369 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._enter() Oct 13 10:59:35.571369 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 10:59:35.571369 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 10:59:35.572656 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 10:59:35.572656 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.creator() Oct 13 10:59:35.572656 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 10:59:35.572656 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application created_value = creator( Oct 13 10:59:35.572656 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 13 10:59:35.572656 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 13 10:59:35.572656 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 13 10:59:35.572656 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 13 10:59:35.572656 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 13 10:59:35.572656 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 13 10:59:35.572656 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 13 10:59:35.572656 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application Oct 13 10:59:35.572656 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 449/893] 10.222.0.18 () {56 vars in 1096 bytes} [Thu Oct 13 10:59:35 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 10:59:35.577316 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6427a58-62a7-48b8-a306-6bdb96a7af16 None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:59:35.671499 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6427a58-62a7-48b8-a306-6bdb96a7af16 None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:59:35.688228 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:59:35.705460 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665bd5da-1540-4d63-bf5d-0dbe2ee6cb8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:59:35.706054 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665bd5da-1540-4d63-bf5d-0dbe2ee6cb8a None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:59:35.706329 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665bd5da-1540-4d63-bf5d-0dbe2ee6cb8a None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:59:35.706599 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665bd5da-1540-4d63-bf5d-0dbe2ee6cb8a None admin] PATH_INFO: `/v3/roles` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:59:35.707261 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-665bd5da-1540-4d63-bf5d-0dbe2ee6cb8a None admin] RBAC: Adding query filter params (name=admin) {{(pid=81534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 10:59:35.707558 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-665bd5da-1540-4d63-bf5d-0dbe2ee6cb8a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:59:35.708930 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-665bd5da-1540-4d63-bf5d-0dbe2ee6cb8a None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:59:35.717684 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 445/894] 10.222.0.18 () {56 vars in 1099 bytes} [Thu Oct 13 10:59:35 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 10:59:35.723432 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6cc7150-e7e7-4292-93df-ece31627d46c None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:59:35.821829 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6cc7150-e7e7-4292-93df-ece31627d46c None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:59:35.854826 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1063ab43-de86-4cf8-908e-e053b3499eae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:59:35.855438 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1063ab43-de86-4cf8-908e-e053b3499eae None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:59:35.855714 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1063ab43-de86-4cf8-908e-e053b3499eae None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:59:35.855986 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1063ab43-de86-4cf8-908e-e053b3499eae None admin] PATH_INFO: `/v3/users/d9cc3cd03bc1458eb8d5e0be348e4831` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:59:35.868449 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1063ab43-de86-4cf8-908e-e053b3499eae None admin] RBAC: Authorizing `identity:get_user(user_id=d9cc3cd03bc1458eb8d5e0be348e4831)` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:59:35.869901 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1063ab43-de86-4cf8-908e-e053b3499eae None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:59:35.871478 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 450/895] 10.222.0.18 () {56 vars in 1177 bytes} [Thu Oct 13 10:59:35 2022] GET /identity/v3/users/d9cc3cd03bc1458eb8d5e0be348e4831 => generated 311 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 10:59:35.877220 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665bd5da-1540-4d63-bf5d-0dbe2ee6cb8a None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:59:35.973210 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665bd5da-1540-4d63-bf5d-0dbe2ee6cb8a None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:59:36.005355 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec22f5e-d1ce-49c0-96cc-d2321c1875f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:59:36.006006 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec22f5e-d1ce-49c0-96cc-d2321c1875f4 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:59:36.006283 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec22f5e-d1ce-49c0-96cc-d2321c1875f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:59:36.006552 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec22f5e-d1ce-49c0-96cc-d2321c1875f4 None admin] PATH_INFO: `/v3/projects/f9e35c11fe324056b59ddcb67eca5ec5` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:59:36.007914 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec22f5e-d1ce-49c0-96cc-d2321c1875f4 None admin] RBAC: Authorizing `identity:get_project(project_id=f9e35c11fe324056b59ddcb67eca5ec5)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:59:36.009348 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec22f5e-d1ce-49c0-96cc-d2321c1875f4 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:59:36.010936 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 446/896] 10.222.0.18 () {56 vars in 1186 bytes} [Thu Oct 13 10:59:35 2022] GET /identity/v3/projects/f9e35c11fe324056b59ddcb67eca5ec5 => generated 361 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 10:59:36.016804 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1063ab43-de86-4cf8-908e-e053b3499eae None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:59:36.068363 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:59:36.113893 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1063ab43-de86-4cf8-908e-e053b3499eae None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:59:36.145785 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ba3711-f490-4c47-9bfd-2266bb7bbd01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:59:36.146937 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ba3711-f490-4c47-9bfd-2266bb7bbd01 None admin] REQUEST_METHOD: `PUT` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:59:36.147283 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ba3711-f490-4c47-9bfd-2266bb7bbd01 None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:59:36.147686 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ba3711-f490-4c47-9bfd-2266bb7bbd01 None admin] PATH_INFO: `/v3/projects/f9e35c11fe324056b59ddcb67eca5ec5/users/d9cc3cd03bc1458eb8d5e0be348e4831/roles/30a6d59262144d4d956f4d4207864030` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:59:36.149572 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ba3711-f490-4c47-9bfd-2266bb7bbd01 None admin] RBAC: Authorizing `identity:create_grant(project_id=f9e35c11fe324056b59ddcb67eca5ec5, user_id=d9cc3cd03bc1458eb8d5e0be348e4831, role_id=30a6d59262144d4d956f4d4207864030)` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:59:36.150978 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ba3711-f490-4c47-9bfd-2266bb7bbd01 None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:59:36.163618 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 451/897] 10.222.0.18 () {58 vars in 1439 bytes} [Thu Oct 13 10:59:36 2022] PUT /identity/v3/projects/f9e35c11fe324056b59ddcb67eca5ec5/users/d9cc3cd03bc1458eb8d5e0be348e4831/roles/30a6d59262144d4d956f4d4207864030 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 10:59:38.273978 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10acf4d-0b91-4a36-b593-a56308348573 None None] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:59:38.274546 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10acf4d-0b91-4a36-b593-a56308348573 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:59:38.274546 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10acf4d-0b91-4a36-b593-a56308348573 None None] PATH_INFO: `/` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:59:38.275861 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 447/898] 10.222.0.18 () {54 vars in 927 bytes} [Thu Oct 13 10:59:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 10:59:38.281026 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7468db-beb7-43d3-a06b-d96b0997dfa9 None None] REQUEST_METHOD: `POST` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:59:38.281413 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7468db-beb7-43d3-a06b-d96b0997dfa9 None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:59:38.281599 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7468db-beb7-43d3-a06b-d96b0997dfa9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:59:38.299241 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.auth.core [None req-6a7468db-beb7-43d3-a06b-d96b0997dfa9 None None] MFA Rules not processed for user `8ba31ade43694cf8bf28f7528a9ea179`. Rule list: `[]` (Enabled: `True`). {{(pid=81533) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 10:59:38.300416 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-6a7468db-beb7-43d3-a06b-d96b0997dfa9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 10:59:38.364443 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 452/899] 10.222.0.18 () {58 vars in 1024 bytes} [Thu Oct 13 10:59:38 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 13 10:59:38.636092 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10acf4d-0b91-4a36-b593-a56308348573 None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:59:38.685502 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:59:38.736047 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10acf4d-0b91-4a36-b593-a56308348573 None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:59:38.769875 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0875ef3-d5f0-473f-b2be-834f3197656d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:59:38.770487 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0875ef3-d5f0-473f-b2be-834f3197656d None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:59:38.770762 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0875ef3-d5f0-473f-b2be-834f3197656d None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:59:38.771035 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0875ef3-d5f0-473f-b2be-834f3197656d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:59:38.780873 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0875ef3-d5f0-473f-b2be-834f3197656d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 13 10:59:38.785582 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application [None req-d0875ef3-d5f0-473f-b2be-834f3197656d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 13 10:59:38.785582 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 10:59:38.785582 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 10:59:38.785582 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 10:59:38.785582 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 10:59:38.785582 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 10:59:38.785582 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 10:59:38.785582 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 10:59:38.785582 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 10:59:38.785582 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 10:59:38.785582 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 10:59:38.785582 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 10:59:38.785582 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 13 10:59:38.785582 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 13 10:59:38.785582 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 13 10:59:38.785582 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 13 10:59:38.786678 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 13 10:59:38.786678 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 13 10:59:38.786678 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 13 10:59:38.786678 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 13 10:59:38.786678 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 10:59:38.786678 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 10:59:38.786678 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 10:59:38.786678 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 10:59:38.786678 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 10:59:38.786678 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 10:59:38.786678 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 10:59:38.786678 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application with Lock( Oct 13 10:59:38.786678 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 10:59:38.786678 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._enter() Oct 13 10:59:38.786678 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 10:59:38.786678 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 10:59:38.788328 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 10:59:38.788328 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.creator() Oct 13 10:59:38.788328 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 10:59:38.788328 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application created_value = creator( Oct 13 10:59:38.788328 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 13 10:59:38.788328 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 13 10:59:38.788328 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 13 10:59:38.788328 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 13 10:59:38.788328 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 13 10:59:38.788328 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 13 10:59:38.788328 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 13 10:59:38.788328 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application Oct 13 10:59:38.788328 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 448/900] 10.222.0.18 () {56 vars in 1096 bytes} [Thu Oct 13 10:59:38 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 10:59:38.793461 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7468db-beb7-43d3-a06b-d96b0997dfa9 None None] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:59:38.835536 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:59:38.891116 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7468db-beb7-43d3-a06b-d96b0997dfa9 None None] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:59:38.924547 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b620e8a-9101-4734-813e-63168732a7fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:59:38.925165 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b620e8a-9101-4734-813e-63168732a7fb None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:59:38.925446 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b620e8a-9101-4734-813e-63168732a7fb None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:59:38.925717 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b620e8a-9101-4734-813e-63168732a7fb None admin] PATH_INFO: `/v3/roles` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:59:38.926376 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b620e8a-9101-4734-813e-63168732a7fb None admin] RBAC: Adding query filter params (name=admin) {{(pid=81533) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 10:59:38.926676 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b620e8a-9101-4734-813e-63168732a7fb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:59:38.928359 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b620e8a-9101-4734-813e-63168732a7fb None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:59:38.936185 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 453/901] 10.222.0.18 () {56 vars in 1099 bytes} [Thu Oct 13 10:59:38 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 10:59:38.942080 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0875ef3-d5f0-473f-b2be-834f3197656d None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:59:39.038365 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0875ef3-d5f0-473f-b2be-834f3197656d None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:59:39.047125 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:59:39.073258 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0420eb-56c8-4637-b262-da29a8742a2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:59:39.073878 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0420eb-56c8-4637-b262-da29a8742a2b None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:59:39.074162 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0420eb-56c8-4637-b262-da29a8742a2b None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:59:39.074430 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0420eb-56c8-4637-b262-da29a8742a2b None admin] PATH_INFO: `/v3/users/d9cc3cd03bc1458eb8d5e0be348e4831` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:59:39.075539 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb0420eb-56c8-4637-b262-da29a8742a2b None admin] RBAC: Authorizing `identity:get_user(user_id=d9cc3cd03bc1458eb8d5e0be348e4831)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:59:39.076959 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb0420eb-56c8-4637-b262-da29a8742a2b None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:59:39.078538 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 449/902] 10.222.0.18 () {56 vars in 1177 bytes} [Thu Oct 13 10:59:38 2022] GET /identity/v3/users/d9cc3cd03bc1458eb8d5e0be348e4831 => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 10:59:39.084746 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b620e8a-9101-4734-813e-63168732a7fb None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:59:39.180735 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b620e8a-9101-4734-813e-63168732a7fb None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:59:39.182994 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:59:39.213757 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529bc435-2018-4acd-887c-4cbd0d66206d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:59:39.214338 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529bc435-2018-4acd-887c-4cbd0d66206d None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:59:39.214610 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529bc435-2018-4acd-887c-4cbd0d66206d None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:59:39.214875 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529bc435-2018-4acd-887c-4cbd0d66206d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:59:39.278603 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-529bc435-2018-4acd-887c-4cbd0d66206d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:59:39.280018 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-529bc435-2018-4acd-887c-4cbd0d66206d None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:59:39.372352 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 454/903] 10.222.0.18 () {58 vars in 1282 bytes} [Thu Oct 13 10:59:39 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 289 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 13 10:59:39.378179 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0420eb-56c8-4637-b262-da29a8742a2b None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:59:39.474877 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0420eb-56c8-4637-b262-da29a8742a2b None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:59:39.507539 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0917f69-9886-4edc-ad75-9c3be79a596e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:59:39.507946 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0917f69-9886-4edc-ad75-9c3be79a596e None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:59:39.508165 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0917f69-9886-4edc-ad75-9c3be79a596e None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:59:39.508436 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0917f69-9886-4edc-ad75-9c3be79a596e None admin] PATH_INFO: `/v3/projects/f9e35c11fe324056b59ddcb67eca5ec5` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:59:39.509568 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0917f69-9886-4edc-ad75-9c3be79a596e None admin] RBAC: Authorizing `identity:get_project(project_id=f9e35c11fe324056b59ddcb67eca5ec5)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:59:39.510975 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0917f69-9886-4edc-ad75-9c3be79a596e None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:59:39.512557 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 450/904] 10.222.0.18 () {56 vars in 1186 bytes} [Thu Oct 13 10:59:39 2022] GET /identity/v3/projects/f9e35c11fe324056b59ddcb67eca5ec5 => generated 361 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 10:59:39.518529 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529bc435-2018-4acd-887c-4cbd0d66206d None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 10:59:39.522120 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:59:39.614213 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529bc435-2018-4acd-887c-4cbd0d66206d None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 10:59:39.648082 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d80b51-95ac-4056-9c2d-fbb91e029d9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 10:59:39.648667 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d80b51-95ac-4056-9c2d-fbb91e029d9d None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 10:59:39.648940 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d80b51-95ac-4056-9c2d-fbb91e029d9d None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 10:59:39.649234 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d80b51-95ac-4056-9c2d-fbb91e029d9d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 10:59:39.649941 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d80b51-95ac-4056-9c2d-fbb91e029d9d None admin] RBAC: Adding query filter params (role.id=30a6d59262144d4d956f4d4207864030, scope.project.id=f9e35c11fe324056b59ddcb67eca5ec5, user.id=d9cc3cd03bc1458eb8d5e0be348e4831) {{(pid=81533) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 10:59:39.650242 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d80b51-95ac-4056-9c2d-fbb91e029d9d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 10:59:39.651674 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d80b51-95ac-4056-9c2d-fbb91e029d9d None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 10:59:39.657256 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 455/905] 10.222.0.18 () {56 vars in 1374 bytes} [Thu Oct 13 10:59:39 2022] GET /identity/v3/role_assignments?user.id=d9cc3cd03bc1458eb8d5e0be348e4831&scope.project.id=f9e35c11fe324056b59ddcb67eca5ec5&role.id=30a6d59262144d4d956f4d4207864030 => generated 608 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 10:59:49.502178 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=78 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:59:49.654690 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=66 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:00:34.795916 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0abca30-ce2f-449a-8c4f-7569d61bffef None None] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:00:34.795916 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0abca30-ce2f-449a-8c4f-7569d61bffef None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:00:34.795916 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0abca30-ce2f-449a-8c4f-7569d61bffef None None] PATH_INFO: `/` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:00:34.795916 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 451/906] 10.222.0.18 () {54 vars in 927 bytes} [Thu Oct 13 11:00:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 11:00:34.802722 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6917b97-47d7-4c61-93d8-b3a32101cf12 None None] REQUEST_METHOD: `POST` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:00:34.803233 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6917b97-47d7-4c61-93d8-b3a32101cf12 None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:00:34.803324 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6917b97-47d7-4c61-93d8-b3a32101cf12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:00:34.823238 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.auth.core [None req-f6917b97-47d7-4c61-93d8-b3a32101cf12 None None] MFA Rules not processed for user `8ba31ade43694cf8bf28f7528a9ea179`. Rule list: `[]` (Enabled: `True`). {{(pid=81533) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 11:00:34.824456 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-f6917b97-47d7-4c61-93d8-b3a32101cf12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:00:34.916715 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 456/907] 10.222.0.18 () {58 vars in 1024 bytes} [Thu Oct 13 11:00:34 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 13 11:00:35.227807 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0abca30-ce2f-449a-8c4f-7569d61bffef None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:00:35.356692 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0abca30-ce2f-449a-8c4f-7569d61bffef None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:00:35.401910 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65152c1-be7c-4a36-ba98-52ebf8a18948 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:00:35.402680 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65152c1-be7c-4a36-ba98-52ebf8a18948 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:00:35.403035 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65152c1-be7c-4a36-ba98-52ebf8a18948 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:00:35.403320 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65152c1-be7c-4a36-ba98-52ebf8a18948 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:00:35.415122 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65152c1-be7c-4a36-ba98-52ebf8a18948 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:00:35.416960 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65152c1-be7c-4a36-ba98-52ebf8a18948 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:00:35.435095 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application [None req-d65152c1-be7c-4a36-ba98-52ebf8a18948 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 13 11:00:35.435095 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 11:00:35.435095 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 11:00:35.435095 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 11:00:35.435095 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 11:00:35.435095 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 11:00:35.435095 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 11:00:35.435095 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 11:00:35.435095 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 11:00:35.435095 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 11:00:35.435095 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 11:00:35.435095 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 11:00:35.435095 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 13 11:00:35.435095 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 13 11:00:35.435095 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 13 11:00:35.435095 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 13 11:00:35.436468 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 11:00:35.436468 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 11:00:35.436468 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 11:00:35.436468 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 11:00:35.436468 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 11:00:35.436468 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 11:00:35.436468 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 11:00:35.436468 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application with Lock( Oct 13 11:00:35.436468 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 11:00:35.436468 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._enter() Oct 13 11:00:35.436468 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 11:00:35.436468 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 11:00:35.436468 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 11:00:35.436468 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.creator() Oct 13 11:00:35.436468 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 11:00:35.436468 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application created_value = creator( Oct 13 11:00:35.436468 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 13 11:00:35.437814 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 13 11:00:35.437814 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 13 11:00:35.437814 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application Oct 13 11:00:35.437814 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 452/908] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Oct 13 11:00:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 11:00:35.443931 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6917b97-47d7-4c61-93d8-b3a32101cf12 None None] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:00:35.564233 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6917b97-47d7-4c61-93d8-b3a32101cf12 None None] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:00:35.599827 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:00:35.608610 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67eebe7-671e-4bbb-b1b0-1b469c82491f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:00:35.609513 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67eebe7-671e-4bbb-b1b0-1b469c82491f None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:00:35.609934 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67eebe7-671e-4bbb-b1b0-1b469c82491f None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:00:35.610335 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67eebe7-671e-4bbb-b1b0-1b469c82491f None admin] PATH_INFO: `/v3/domains` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:00:35.611131 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67eebe7-671e-4bbb-b1b0-1b469c82491f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81533) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 11:00:35.611497 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67eebe7-671e-4bbb-b1b0-1b469c82491f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:00:35.613142 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67eebe7-671e-4bbb-b1b0-1b469c82491f None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:00:35.632645 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 457/909] 10.222.0.18 () {56 vars in 1109 bytes} [Thu Oct 13 11:00:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 11:00:35.634873 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65152c1-be7c-4a36-ba98-52ebf8a18948 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:00:35.716321 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:00:35.784329 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65152c1-be7c-4a36-ba98-52ebf8a18948 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:00:35.825823 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639c7cb7-fa07-4209-a0c9-dd9adadd1fc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:00:35.826495 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639c7cb7-fa07-4209-a0c9-dd9adadd1fc1 None admin] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:00:35.826671 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639c7cb7-fa07-4209-a0c9-dd9adadd1fc1 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:00:35.826877 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639c7cb7-fa07-4209-a0c9-dd9adadd1fc1 None admin] PATH_INFO: `/v3/users` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:00:35.827529 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-639c7cb7-fa07-4209-a0c9-dd9adadd1fc1 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:00:35.828941 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-639c7cb7-fa07-4209-a0c9-dd9adadd1fc1 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:00:35.854227 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 453/910] 10.222.0.18 () {60 vars in 1132 bytes} [Thu Oct 13 11:00:35 2022] POST /identity/v3/users => generated 251 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 13 11:00:38.202544 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c142db52-f36e-49a8-803a-430f18ad0ded None None] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:00:38.203134 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c142db52-f36e-49a8-803a-430f18ad0ded None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:00:38.203134 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c142db52-f36e-49a8-803a-430f18ad0ded None None] PATH_INFO: `/` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:00:38.204419 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 458/911] 10.222.0.18 () {54 vars in 927 bytes} [Thu Oct 13 11:00:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 11:00:38.210885 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dde2773-1a80-4cc3-8891-8978feab967c None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:00:38.211341 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dde2773-1a80-4cc3-8891-8978feab967c None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:00:38.211423 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dde2773-1a80-4cc3-8891-8978feab967c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:00:38.230667 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-0dde2773-1a80-4cc3-8891-8978feab967c None None] MFA Rules not processed for user `8ba31ade43694cf8bf28f7528a9ea179`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 11:00:38.231849 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-0dde2773-1a80-4cc3-8891-8978feab967c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:00:38.307151 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 454/912] 10.222.0.18 () {58 vars in 1024 bytes} [Thu Oct 13 11:00:38 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 13 11:00:38.626808 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c142db52-f36e-49a8-803a-430f18ad0ded None None] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:00:38.753528 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c142db52-f36e-49a8-803a-430f18ad0ded None None] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:00:38.799369 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb91a2cc-7e6f-4dde-85dc-7bd9f525172c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:00:38.800001 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb91a2cc-7e6f-4dde-85dc-7bd9f525172c None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:00:38.800278 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb91a2cc-7e6f-4dde-85dc-7bd9f525172c None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:00:38.800547 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb91a2cc-7e6f-4dde-85dc-7bd9f525172c None admin] PATH_INFO: `/v3/roles/service` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:00:38.812300 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb91a2cc-7e6f-4dde-85dc-7bd9f525172c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 13 11:00:38.817083 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application [None req-cb91a2cc-7e6f-4dde-85dc-7bd9f525172c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 13 11:00:38.817083 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 11:00:38.817083 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 11:00:38.817083 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 11:00:38.817083 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 11:00:38.817083 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 11:00:38.817083 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 11:00:38.817083 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 11:00:38.817083 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 11:00:38.817083 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 11:00:38.817083 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 11:00:38.817083 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 11:00:38.817083 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 13 11:00:38.817083 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 13 11:00:38.817083 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 13 11:00:38.817083 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 13 11:00:38.821227 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 13 11:00:38.821227 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 13 11:00:38.821227 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 13 11:00:38.821227 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 13 11:00:38.821227 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 11:00:38.821227 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 11:00:38.821227 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 11:00:38.821227 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 11:00:38.821227 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 11:00:38.821227 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 11:00:38.821227 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 11:00:38.821227 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application with Lock( Oct 13 11:00:38.821227 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 11:00:38.821227 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._enter() Oct 13 11:00:38.821227 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 11:00:38.821227 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 11:00:38.822394 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 11:00:38.822394 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.creator() Oct 13 11:00:38.822394 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 11:00:38.822394 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application created_value = creator( Oct 13 11:00:38.822394 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 13 11:00:38.822394 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 13 11:00:38.822394 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 13 11:00:38.822394 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 13 11:00:38.822394 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 13 11:00:38.822394 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 13 11:00:38.822394 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 13 11:00:38.822394 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application Oct 13 11:00:38.822394 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 459/913] 10.222.0.18 () {56 vars in 1102 bytes} [Thu Oct 13 11:00:38 2022] GET /identity/v3/roles/service => generated 85 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 11:00:38.827457 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dde2773-1a80-4cc3-8891-8978feab967c None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:00:38.872292 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:00:38.941141 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dde2773-1a80-4cc3-8891-8978feab967c None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:00:38.981063 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0071fabe-29e4-42e9-8566-c726a2d80715 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:00:38.981063 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0071fabe-29e4-42e9-8566-c726a2d80715 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:00:38.981063 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0071fabe-29e4-42e9-8566-c726a2d80715 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:00:38.981063 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0071fabe-29e4-42e9-8566-c726a2d80715 None admin] PATH_INFO: `/v3/roles` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:00:38.981538 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0071fabe-29e4-42e9-8566-c726a2d80715 None admin] RBAC: Adding query filter params (name=service) {{(pid=81534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 11:00:38.981538 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0071fabe-29e4-42e9-8566-c726a2d80715 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:00:38.981677 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0071fabe-29e4-42e9-8566-c726a2d80715 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:00:38.995581 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 455/914] 10.222.0.18 () {56 vars in 1103 bytes} [Thu Oct 13 11:00:38 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 11:00:38.997438 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb91a2cc-7e6f-4dde-85dc-7bd9f525172c None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:00:39.053600 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:00:39.114291 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb91a2cc-7e6f-4dde-85dc-7bd9f525172c None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:00:39.157882 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b1fc22-6542-4140-8696-1b4e5d587895 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:00:39.158693 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b1fc22-6542-4140-8696-1b4e5d587895 None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:00:39.158951 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b1fc22-6542-4140-8696-1b4e5d587895 None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:00:39.159277 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b1fc22-6542-4140-8696-1b4e5d587895 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:00:39.171481 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b1fc22-6542-4140-8696-1b4e5d587895 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:00:39.172931 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b1fc22-6542-4140-8696-1b4e5d587895 None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:00:39.189366 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application [None req-02b1fc22-6542-4140-8696-1b4e5d587895 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 13 11:00:39.189366 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 11:00:39.189366 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 11:00:39.189366 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 11:00:39.189366 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 11:00:39.189366 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 11:00:39.189366 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 11:00:39.189366 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 11:00:39.189366 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 11:00:39.189366 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 11:00:39.189366 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 11:00:39.189366 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 11:00:39.189366 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 13 11:00:39.189366 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 13 11:00:39.189366 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 13 11:00:39.189366 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 13 11:00:39.190951 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 11:00:39.190951 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 11:00:39.190951 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 11:00:39.190951 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 11:00:39.190951 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 11:00:39.190951 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 11:00:39.190951 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 11:00:39.190951 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application with Lock( Oct 13 11:00:39.190951 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 11:00:39.190951 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._enter() Oct 13 11:00:39.190951 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 11:00:39.190951 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 11:00:39.190951 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 11:00:39.190951 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.creator() Oct 13 11:00:39.190951 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 11:00:39.190951 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application created_value = creator( Oct 13 11:00:39.190951 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 13 11:00:39.192386 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 13 11:00:39.192386 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 13 11:00:39.192386 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application Oct 13 11:00:39.192386 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 460/915] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Oct 13 11:00:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 11:00:39.196844 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0071fabe-29e4-42e9-8566-c726a2d80715 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:00:39.310399 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:00:39.314117 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0071fabe-29e4-42e9-8566-c726a2d80715 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:00:39.358012 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c35747-6d1e-46b4-9f3f-c34053e85b2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:00:39.358969 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c35747-6d1e-46b4-9f3f-c34053e85b2b None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:00:39.359525 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c35747-6d1e-46b4-9f3f-c34053e85b2b None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:00:39.360000 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c35747-6d1e-46b4-9f3f-c34053e85b2b None admin] PATH_INFO: `/v3/domains` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:00:39.360912 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c35747-6d1e-46b4-9f3f-c34053e85b2b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 11:00:39.361346 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c35747-6d1e-46b4-9f3f-c34053e85b2b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:00:39.363074 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c35747-6d1e-46b4-9f3f-c34053e85b2b None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:00:39.382867 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 456/916] 10.222.0.18 () {56 vars in 1109 bytes} [Thu Oct 13 11:00:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 11:00:39.385249 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b1fc22-6542-4140-8696-1b4e5d587895 None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:00:39.506343 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b1fc22-6542-4140-8696-1b4e5d587895 None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:00:39.508635 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:00:39.545289 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bfcf273-44d1-4535-998f-ee8de38b01d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:00:39.545976 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfcf273-44d1-4535-998f-ee8de38b01d9 None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:00:39.546262 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfcf273-44d1-4535-998f-ee8de38b01d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:00:39.546534 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfcf273-44d1-4535-998f-ee8de38b01d9 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:00:39.555901 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bfcf273-44d1-4535-998f-ee8de38b01d9 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:00:39.558069 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bfcf273-44d1-4535-998f-ee8de38b01d9 None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:00:39.571004 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application [None req-9bfcf273-44d1-4535-998f-ee8de38b01d9 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Oct 13 11:00:39.571004 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 11:00:39.571004 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 11:00:39.571004 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 11:00:39.571004 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 11:00:39.571004 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 11:00:39.571004 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 11:00:39.571004 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 11:00:39.571004 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 11:00:39.571004 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 11:00:39.571004 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 11:00:39.571004 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 11:00:39.571004 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 13 11:00:39.571004 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 13 11:00:39.571004 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 13 11:00:39.571004 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 13 11:00:39.576893 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 11:00:39.576893 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 11:00:39.576893 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 13 11:00:39.576893 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 13 11:00:39.576893 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 13 11:00:39.576893 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 13 11:00:39.576893 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 11:00:39.576893 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 11:00:39.576893 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 11:00:39.576893 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 11:00:39.576893 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 11:00:39.576893 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application with Lock( Oct 13 11:00:39.576893 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 11:00:39.576893 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._enter() Oct 13 11:00:39.576893 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 11:00:39.576893 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 11:00:39.576893 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 11:00:39.576893 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.creator() Oct 13 11:00:39.578158 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 11:00:39.578158 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application created_value = creator( Oct 13 11:00:39.578158 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 13 11:00:39.578158 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 13 11:00:39.578158 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 13 11:00:39.578158 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 13 11:00:39.578158 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 13 11:00:39.578158 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 13 11:00:39.578158 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Oct 13 11:00:39.578158 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application Oct 13 11:00:39.578158 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 461/917] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Oct 13 11:00:39 2022] GET /identity/v3/users/placement => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 11:00:39.578927 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c35747-6d1e-46b4-9f3f-c34053e85b2b None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:00:39.705021 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c35747-6d1e-46b4-9f3f-c34053e85b2b None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:00:39.758355 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7e2623-367b-43f8-92c7-325634e041f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:00:39.759141 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7e2623-367b-43f8-92c7-325634e041f1 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:00:39.759411 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7e2623-367b-43f8-92c7-325634e041f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:00:39.760056 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7e2623-367b-43f8-92c7-325634e041f1 None admin] PATH_INFO: `/v3/users` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:00:39.760910 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7e2623-367b-43f8-92c7-325634e041f1 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 11:00:39.761334 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7e2623-367b-43f8-92c7-325634e041f1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:00:39.763356 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7e2623-367b-43f8-92c7-325634e041f1 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:00:39.783809 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 457/918] 10.222.0.18 () {56 vars in 1143 bytes} [Thu Oct 13 11:00:39 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 11:00:39.790169 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bfcf273-44d1-4535-998f-ee8de38b01d9 None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:00:39.906256 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bfcf273-44d1-4535-998f-ee8de38b01d9 None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:00:39.944970 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16356ce3-1dd6-4172-931a-d8385ebc1aff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:00:39.945649 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16356ce3-1dd6-4172-931a-d8385ebc1aff None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:00:39.945930 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16356ce3-1dd6-4172-931a-d8385ebc1aff None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:00:39.946205 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16356ce3-1dd6-4172-931a-d8385ebc1aff None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:00:39.957843 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16356ce3-1dd6-4172-931a-d8385ebc1aff None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:00:39.959379 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16356ce3-1dd6-4172-931a-d8385ebc1aff None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:00:39.976303 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application [None req-16356ce3-1dd6-4172-931a-d8385ebc1aff None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 13 11:00:39.976303 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 11:00:39.976303 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 11:00:39.976303 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 11:00:39.976303 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 11:00:39.976303 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 11:00:39.976303 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 11:00:39.976303 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 11:00:39.976303 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 11:00:39.976303 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 11:00:39.976303 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 11:00:39.976303 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 11:00:39.976303 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 13 11:00:39.976303 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 13 11:00:39.976303 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 13 11:00:39.976303 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 13 11:00:39.977396 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 11:00:39.977396 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 11:00:39.977396 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 11:00:39.977396 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 11:00:39.977396 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 11:00:39.977396 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 11:00:39.977396 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 11:00:39.977396 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application with Lock( Oct 13 11:00:39.977396 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 11:00:39.977396 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._enter() Oct 13 11:00:39.977396 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 11:00:39.977396 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 11:00:39.977396 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 11:00:39.977396 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.creator() Oct 13 11:00:39.977396 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 11:00:39.977396 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application created_value = creator( Oct 13 11:00:39.977396 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 13 11:00:39.983343 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 13 11:00:39.983343 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 13 11:00:39.983343 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application Oct 13 11:00:39.983343 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 462/919] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Oct 13 11:00:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 11:00:39.983637 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7e2623-367b-43f8-92c7-325634e041f1 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:00:40.008212 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:00:40.105310 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7e2623-367b-43f8-92c7-325634e041f1 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:00:40.145200 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d291bb-f460-44ad-9c80-5a690bb185d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:00:40.145812 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d291bb-f460-44ad-9c80-5a690bb185d0 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:00:40.146269 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d291bb-f460-44ad-9c80-5a690bb185d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:00:40.146898 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d291bb-f460-44ad-9c80-5a690bb185d0 None admin] PATH_INFO: `/v3/domains` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:00:40.147544 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d291bb-f460-44ad-9c80-5a690bb185d0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 11:00:40.147848 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d291bb-f460-44ad-9c80-5a690bb185d0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:00:40.149433 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d291bb-f460-44ad-9c80-5a690bb185d0 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:00:40.165046 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 458/920] 10.222.0.18 () {56 vars in 1109 bytes} [Thu Oct 13 11:00:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 11:00:40.169958 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16356ce3-1dd6-4172-931a-d8385ebc1aff None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:00:40.190608 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:00:40.291577 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16356ce3-1dd6-4172-931a-d8385ebc1aff None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:00:40.333418 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726e8f7d-00cf-41aa-9820-06fbea73680f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:00:40.334662 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726e8f7d-00cf-41aa-9820-06fbea73680f None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:00:40.334946 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726e8f7d-00cf-41aa-9820-06fbea73680f None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:00:40.335234 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726e8f7d-00cf-41aa-9820-06fbea73680f None admin] PATH_INFO: `/v3/projects/service` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:00:40.342740 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-726e8f7d-00cf-41aa-9820-06fbea73680f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:00:40.344341 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-726e8f7d-00cf-41aa-9820-06fbea73680f None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:00:40.357053 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application [None req-726e8f7d-00cf-41aa-9820-06fbea73680f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 13 11:00:40.357053 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 11:00:40.357053 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 11:00:40.357053 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 11:00:40.357053 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 11:00:40.357053 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 11:00:40.357053 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 11:00:40.357053 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 11:00:40.357053 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 11:00:40.357053 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 11:00:40.357053 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 11:00:40.357053 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 11:00:40.357053 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 13 11:00:40.357053 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 13 11:00:40.357053 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 13 11:00:40.358061 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 13 11:00:40.358061 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 11:00:40.358061 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 11:00:40.358061 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 11:00:40.358061 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 11:00:40.358061 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 11:00:40.358061 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 11:00:40.358061 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 11:00:40.358061 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application with Lock( Oct 13 11:00:40.358061 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 11:00:40.358061 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._enter() Oct 13 11:00:40.358061 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 11:00:40.358061 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 11:00:40.358061 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 11:00:40.358061 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.creator() Oct 13 11:00:40.358061 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 11:00:40.358061 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application created_value = creator( Oct 13 11:00:40.358956 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 13 11:00:40.358956 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 13 11:00:40.358956 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 13 11:00:40.358956 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 13 11:00:40.358956 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 13 11:00:40.358956 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 13 11:00:40.358956 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 13 11:00:40.358956 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application Oct 13 11:00:40.358956 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 463/921] 10.222.0.18 () {56 vars in 1111 bytes} [Thu Oct 13 11:00:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 13 11:00:40.366143 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d291bb-f460-44ad-9c80-5a690bb185d0 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:00:40.464695 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:00:40.492890 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d291bb-f460-44ad-9c80-5a690bb185d0 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:00:40.533547 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5147d29-229c-49da-9163-3b482bf4a317 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:00:40.534163 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5147d29-229c-49da-9163-3b482bf4a317 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:00:40.534439 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5147d29-229c-49da-9163-3b482bf4a317 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:00:40.534709 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5147d29-229c-49da-9163-3b482bf4a317 None admin] PATH_INFO: `/v3/projects` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:00:40.535412 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5147d29-229c-49da-9163-3b482bf4a317 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 11:00:40.535708 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5147d29-229c-49da-9163-3b482bf4a317 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:00:40.537222 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5147d29-229c-49da-9163-3b482bf4a317 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:00:40.553107 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 459/922] 10.222.0.18 () {56 vars in 1148 bytes} [Thu Oct 13 11:00:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 11:00:40.556992 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726e8f7d-00cf-41aa-9820-06fbea73680f None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:00:40.644846 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:00:40.676013 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726e8f7d-00cf-41aa-9820-06fbea73680f None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:00:40.715686 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb776fb-2aed-4cc4-b265-036b24231390 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:00:40.716482 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb776fb-2aed-4cc4-b265-036b24231390 None admin] REQUEST_METHOD: `PUT` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:00:40.716962 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb776fb-2aed-4cc4-b265-036b24231390 None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:00:40.717362 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb776fb-2aed-4cc4-b265-036b24231390 None admin] PATH_INFO: `/v3/projects/112613528384453abe7506465609fbd8/users/2ccb162f8c154aad96f8e71b26406337/roles/6af7358ee6934ea2830749333f35aa5c` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:00:40.734520 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb776fb-2aed-4cc4-b265-036b24231390 None admin] RBAC: Authorizing `identity:create_grant(project_id=112613528384453abe7506465609fbd8, user_id=2ccb162f8c154aad96f8e71b26406337, role_id=6af7358ee6934ea2830749333f35aa5c)` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:00:40.736302 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb776fb-2aed-4cc4-b265-036b24231390 None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:00:40.753885 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 464/923] 10.222.0.18 () {58 vars in 1439 bytes} [Thu Oct 13 11:00:40 2022] PUT /identity/v3/projects/112613528384453abe7506465609fbd8/users/2ccb162f8c154aad96f8e71b26406337/roles/6af7358ee6934ea2830749333f35aa5c => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 11:00:43.168158 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e44060-8e11-44ca-b596-6c42a6b052ec None None] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:00:43.168681 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e44060-8e11-44ca-b596-6c42a6b052ec None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:00:43.168681 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e44060-8e11-44ca-b596-6c42a6b052ec None None] PATH_INFO: `/` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:00:43.170290 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 460/924] 10.222.0.18 () {54 vars in 927 bytes} [Thu Oct 13 11:00:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 11:00:43.175418 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db604376-3b57-425b-98bc-6bbbd9afbb36 None None] REQUEST_METHOD: `POST` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:00:43.175908 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db604376-3b57-425b-98bc-6bbbd9afbb36 None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:00:43.176011 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db604376-3b57-425b-98bc-6bbbd9afbb36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:00:43.195700 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.auth.core [None req-db604376-3b57-425b-98bc-6bbbd9afbb36 None None] MFA Rules not processed for user `8ba31ade43694cf8bf28f7528a9ea179`. Rule list: `[]` (Enabled: `True`). {{(pid=81533) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 11:00:43.196962 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-db604376-3b57-425b-98bc-6bbbd9afbb36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:00:43.268781 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 465/925] 10.222.0.18 () {58 vars in 1024 bytes} [Thu Oct 13 11:00:43 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 13 11:00:43.552100 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e44060-8e11-44ca-b596-6c42a6b052ec None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:00:43.675067 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e44060-8e11-44ca-b596-6c42a6b052ec None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:00:43.710719 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b2559a-363a-4d68-ba4b-f4ee15735a7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:00:43.711355 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b2559a-363a-4d68-ba4b-f4ee15735a7a None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:00:43.711636 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b2559a-363a-4d68-ba4b-f4ee15735a7a None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:00:43.711908 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b2559a-363a-4d68-ba4b-f4ee15735a7a None admin] PATH_INFO: `/v3/roles/service` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:00:43.719348 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:00:43.723676 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b2559a-363a-4d68-ba4b-f4ee15735a7a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 13 11:00:43.728895 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application [None req-e1b2559a-363a-4d68-ba4b-f4ee15735a7a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 13 11:00:43.728895 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 11:00:43.728895 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 11:00:43.728895 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 11:00:43.728895 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 11:00:43.728895 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 11:00:43.728895 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 11:00:43.728895 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 11:00:43.728895 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 11:00:43.728895 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 11:00:43.728895 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 11:00:43.728895 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 11:00:43.728895 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 13 11:00:43.728895 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 13 11:00:43.728895 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 13 11:00:43.728895 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 13 11:00:43.729918 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 13 11:00:43.729918 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 13 11:00:43.729918 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 13 11:00:43.729918 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 13 11:00:43.729918 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 11:00:43.729918 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 11:00:43.729918 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 11:00:43.729918 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 11:00:43.729918 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 11:00:43.729918 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 11:00:43.729918 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 11:00:43.729918 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application with Lock( Oct 13 11:00:43.729918 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 11:00:43.729918 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._enter() Oct 13 11:00:43.729918 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 11:00:43.729918 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 11:00:43.731517 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 11:00:43.731517 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.creator() Oct 13 11:00:43.731517 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 11:00:43.731517 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application created_value = creator( Oct 13 11:00:43.731517 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 13 11:00:43.731517 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 13 11:00:43.731517 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 13 11:00:43.731517 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 13 11:00:43.731517 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 13 11:00:43.731517 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 13 11:00:43.731517 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 13 11:00:43.731517 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application Oct 13 11:00:43.731517 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 461/926] 10.222.0.18 () {56 vars in 1102 bytes} [Thu Oct 13 11:00:43 2022] GET /identity/v3/roles/service => generated 85 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 11:00:43.736229 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db604376-3b57-425b-98bc-6bbbd9afbb36 None None] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:00:43.795008 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:00:43.845184 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db604376-3b57-425b-98bc-6bbbd9afbb36 None None] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:00:43.882874 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a535fe4-729d-4348-96be-f5a3f16bd2f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:00:43.883462 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a535fe4-729d-4348-96be-f5a3f16bd2f6 None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:00:43.883738 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a535fe4-729d-4348-96be-f5a3f16bd2f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:00:43.884005 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a535fe4-729d-4348-96be-f5a3f16bd2f6 None admin] PATH_INFO: `/v3/roles` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:00:43.884715 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a535fe4-729d-4348-96be-f5a3f16bd2f6 None admin] RBAC: Adding query filter params (name=service) {{(pid=81533) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 11:00:43.885354 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a535fe4-729d-4348-96be-f5a3f16bd2f6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:00:43.886951 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a535fe4-729d-4348-96be-f5a3f16bd2f6 None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:00:43.896969 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 466/927] 10.222.0.18 () {56 vars in 1103 bytes} [Thu Oct 13 11:00:43 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 11:00:43.902898 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b2559a-363a-4d68-ba4b-f4ee15735a7a None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:00:44.005508 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b2559a-363a-4d68-ba4b-f4ee15735a7a None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:00:44.042840 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfa1e87-8645-4f2f-aae9-cb4acc28b6a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:00:44.043468 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfa1e87-8645-4f2f-aae9-cb4acc28b6a7 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:00:44.043745 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfa1e87-8645-4f2f-aae9-cb4acc28b6a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:00:44.044021 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfa1e87-8645-4f2f-aae9-cb4acc28b6a7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:00:44.055027 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcfa1e87-8645-4f2f-aae9-cb4acc28b6a7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:00:44.056462 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcfa1e87-8645-4f2f-aae9-cb4acc28b6a7 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:00:44.071254 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application [None req-fcfa1e87-8645-4f2f-aae9-cb4acc28b6a7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 13 11:00:44.071254 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 11:00:44.071254 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 11:00:44.071254 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 11:00:44.071254 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 11:00:44.071254 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 11:00:44.071254 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 11:00:44.071254 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 11:00:44.071254 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 11:00:44.071254 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 11:00:44.071254 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 11:00:44.071254 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 11:00:44.071254 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 13 11:00:44.071254 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 13 11:00:44.071254 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 13 11:00:44.071254 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 13 11:00:44.072422 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 11:00:44.072422 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 11:00:44.072422 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 11:00:44.072422 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 11:00:44.072422 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 11:00:44.072422 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 11:00:44.072422 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 11:00:44.072422 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application with Lock( Oct 13 11:00:44.072422 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 11:00:44.072422 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._enter() Oct 13 11:00:44.072422 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 11:00:44.072422 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 11:00:44.072422 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 11:00:44.072422 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.creator() Oct 13 11:00:44.072422 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 11:00:44.072422 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application created_value = creator( Oct 13 11:00:44.072422 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 13 11:00:44.073533 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 13 11:00:44.073533 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 13 11:00:44.073533 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application Oct 13 11:00:44.077276 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 462/928] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Oct 13 11:00:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 11:00:44.078210 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a535fe4-729d-4348-96be-f5a3f16bd2f6 None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:00:44.180791 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a535fe4-729d-4348-96be-f5a3f16bd2f6 None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:00:44.197449 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:00:44.218054 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb38ab9e-8d32-4367-9b5e-fcac77d70e4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:00:44.218592 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb38ab9e-8d32-4367-9b5e-fcac77d70e4d None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:00:44.218876 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb38ab9e-8d32-4367-9b5e-fcac77d70e4d None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:00:44.219180 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb38ab9e-8d32-4367-9b5e-fcac77d70e4d None admin] PATH_INFO: `/v3/domains` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:00:44.219858 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb38ab9e-8d32-4367-9b5e-fcac77d70e4d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81533) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 11:00:44.220204 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb38ab9e-8d32-4367-9b5e-fcac77d70e4d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:00:44.221794 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb38ab9e-8d32-4367-9b5e-fcac77d70e4d None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:00:44.234722 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 467/929] 10.222.0.18 () {56 vars in 1109 bytes} [Thu Oct 13 11:00:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 13 11:00:44.241860 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfa1e87-8645-4f2f-aae9-cb4acc28b6a7 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:00:44.296670 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:00:44.349031 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfa1e87-8645-4f2f-aae9-cb4acc28b6a7 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:00:44.383818 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7ec3c8-cafa-4f0f-bc79-c1cc4c8f4795 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:00:44.386027 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7ec3c8-cafa-4f0f-bc79-c1cc4c8f4795 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:00:44.386027 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7ec3c8-cafa-4f0f-bc79-c1cc4c8f4795 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:00:44.386027 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7ec3c8-cafa-4f0f-bc79-c1cc4c8f4795 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:00:44.393529 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7ec3c8-cafa-4f0f-bc79-c1cc4c8f4795 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:00:44.394979 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7ec3c8-cafa-4f0f-bc79-c1cc4c8f4795 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:00:44.407067 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application [None req-1a7ec3c8-cafa-4f0f-bc79-c1cc4c8f4795 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Oct 13 11:00:44.407067 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 11:00:44.407067 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 11:00:44.407067 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 11:00:44.407067 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 11:00:44.407067 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 11:00:44.407067 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 11:00:44.407067 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 11:00:44.407067 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 11:00:44.407067 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 11:00:44.407067 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 11:00:44.407067 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 11:00:44.407067 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 13 11:00:44.407067 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 13 11:00:44.407067 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 13 11:00:44.407067 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 13 11:00:44.408197 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 11:00:44.408197 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 11:00:44.408197 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 13 11:00:44.408197 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 13 11:00:44.408197 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 13 11:00:44.408197 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 13 11:00:44.408197 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 11:00:44.408197 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 11:00:44.408197 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 11:00:44.408197 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 11:00:44.408197 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 11:00:44.408197 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application with Lock( Oct 13 11:00:44.408197 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 11:00:44.408197 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._enter() Oct 13 11:00:44.408197 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 11:00:44.408197 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 11:00:44.408197 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 11:00:44.408197 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.creator() Oct 13 11:00:44.409183 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 11:00:44.409183 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application created_value = creator( Oct 13 11:00:44.409183 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 13 11:00:44.409183 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 13 11:00:44.409183 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 13 11:00:44.409183 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 13 11:00:44.409183 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 13 11:00:44.409183 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 13 11:00:44.409183 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Oct 13 11:00:44.409183 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application Oct 13 11:00:44.409183 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 463/930] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Oct 13 11:00:44 2022] GET /identity/v3/users/placement => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 11:00:44.414181 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb38ab9e-8d32-4367-9b5e-fcac77d70e4d None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:00:44.527713 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb38ab9e-8d32-4367-9b5e-fcac77d70e4d None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:00:44.563727 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665e6b58-c679-4a5c-a736-ec64ac6231a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:00:44.564332 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665e6b58-c679-4a5c-a736-ec64ac6231a5 None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:00:44.564616 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665e6b58-c679-4a5c-a736-ec64ac6231a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:00:44.564876 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665e6b58-c679-4a5c-a736-ec64ac6231a5 None admin] PATH_INFO: `/v3/users` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:00:44.565627 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-665e6b58-c679-4a5c-a736-ec64ac6231a5 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81533) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 11:00:44.565929 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-665e6b58-c679-4a5c-a736-ec64ac6231a5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:00:44.567354 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-665e6b58-c679-4a5c-a736-ec64ac6231a5 None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:00:44.584719 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 468/931] 10.222.0.18 () {56 vars in 1143 bytes} [Thu Oct 13 11:00:44 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 11:00:44.590905 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7ec3c8-cafa-4f0f-bc79-c1cc4c8f4795 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:00:44.702127 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7ec3c8-cafa-4f0f-bc79-c1cc4c8f4795 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:00:44.712417 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:00:44.739515 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f763d88b-9e13-487c-897e-a1f43420d0ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:00:44.740640 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f763d88b-9e13-487c-897e-a1f43420d0ab None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:00:44.741024 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f763d88b-9e13-487c-897e-a1f43420d0ab None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:00:44.741332 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f763d88b-9e13-487c-897e-a1f43420d0ab None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:00:44.827022 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f763d88b-9e13-487c-897e-a1f43420d0ab None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:00:44.828393 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f763d88b-9e13-487c-897e-a1f43420d0ab None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:00:44.937739 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 464/932] 10.222.0.18 () {58 vars in 1282 bytes} [Thu Oct 13 11:00:44 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 13 11:00:44.938940 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665e6b58-c679-4a5c-a736-ec64ac6231a5 None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:00:44.975827 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:00:45.051791 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665e6b58-c679-4a5c-a736-ec64ac6231a5 None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:00:45.090055 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b946f7-8535-4454-901c-538ba36bbd10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:00:45.090605 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b946f7-8535-4454-901c-538ba36bbd10 None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:00:45.090907 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b946f7-8535-4454-901c-538ba36bbd10 None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:00:45.091173 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b946f7-8535-4454-901c-538ba36bbd10 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:00:45.101591 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b946f7-8535-4454-901c-538ba36bbd10 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:00:45.103014 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b946f7-8535-4454-901c-538ba36bbd10 None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:00:45.118161 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application [None req-62b946f7-8535-4454-901c-538ba36bbd10 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 13 11:00:45.118161 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 11:00:45.118161 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 11:00:45.118161 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 11:00:45.118161 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 11:00:45.118161 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 11:00:45.118161 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 11:00:45.118161 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 11:00:45.118161 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 11:00:45.118161 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 11:00:45.118161 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 11:00:45.118161 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 11:00:45.118161 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 13 11:00:45.118161 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 13 11:00:45.118161 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 13 11:00:45.118161 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 13 11:00:45.119119 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 11:00:45.119119 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 11:00:45.119119 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 11:00:45.119119 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 11:00:45.119119 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 11:00:45.119119 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 11:00:45.119119 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 11:00:45.119119 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application with Lock( Oct 13 11:00:45.119119 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 11:00:45.119119 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._enter() Oct 13 11:00:45.119119 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 11:00:45.119119 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 11:00:45.119119 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 11:00:45.119119 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.creator() Oct 13 11:00:45.119119 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 11:00:45.119119 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application created_value = creator( Oct 13 11:00:45.119119 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 13 11:00:45.120150 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 13 11:00:45.120150 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 13 11:00:45.120150 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application Oct 13 11:00:45.120150 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 469/933] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Oct 13 11:00:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 13 11:00:45.125093 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f763d88b-9e13-487c-897e-a1f43420d0ab None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:00:45.137875 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:00:45.227426 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f763d88b-9e13-487c-897e-a1f43420d0ab None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:00:45.262517 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed89cf38-371a-44b3-8f0a-fc7e1765391a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:00:45.263177 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed89cf38-371a-44b3-8f0a-fc7e1765391a None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:00:45.263394 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed89cf38-371a-44b3-8f0a-fc7e1765391a None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:00:45.263659 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed89cf38-371a-44b3-8f0a-fc7e1765391a None admin] PATH_INFO: `/v3/domains` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:00:45.264296 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed89cf38-371a-44b3-8f0a-fc7e1765391a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 11:00:45.264613 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed89cf38-371a-44b3-8f0a-fc7e1765391a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:00:45.265982 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed89cf38-371a-44b3-8f0a-fc7e1765391a None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:00:45.277402 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 465/934] 10.222.0.18 () {56 vars in 1109 bytes} [Thu Oct 13 11:00:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 11:00:45.283131 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b946f7-8535-4454-901c-538ba36bbd10 None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:00:45.371960 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:00:45.389891 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b946f7-8535-4454-901c-538ba36bbd10 None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:00:45.428927 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fabe03ed-2250-4f28-9daa-4215add70327 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:00:45.429608 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabe03ed-2250-4f28-9daa-4215add70327 None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:00:45.429863 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabe03ed-2250-4f28-9daa-4215add70327 None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:00:45.430131 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabe03ed-2250-4f28-9daa-4215add70327 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:00:45.437094 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fabe03ed-2250-4f28-9daa-4215add70327 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:00:45.438497 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fabe03ed-2250-4f28-9daa-4215add70327 None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:00:45.451063 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application [None req-fabe03ed-2250-4f28-9daa-4215add70327 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 13 11:00:45.451063 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 11:00:45.451063 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 11:00:45.451063 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 11:00:45.451063 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 11:00:45.451063 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 11:00:45.451063 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 11:00:45.451063 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 11:00:45.451063 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 11:00:45.451063 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 11:00:45.451063 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 11:00:45.451063 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 11:00:45.451063 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 13 11:00:45.451063 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 13 11:00:45.451063 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 13 11:00:45.452183 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 13 11:00:45.452183 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 11:00:45.452183 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 11:00:45.452183 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 11:00:45.452183 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 11:00:45.452183 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 11:00:45.452183 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 11:00:45.452183 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 11:00:45.452183 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application with Lock( Oct 13 11:00:45.452183 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 11:00:45.452183 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._enter() Oct 13 11:00:45.452183 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 11:00:45.452183 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 11:00:45.452183 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 11:00:45.452183 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.creator() Oct 13 11:00:45.452183 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 11:00:45.452183 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application created_value = creator( Oct 13 11:00:45.458143 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 13 11:00:45.458143 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 13 11:00:45.458143 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 13 11:00:45.458143 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 13 11:00:45.458143 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 13 11:00:45.458143 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 13 11:00:45.458143 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 13 11:00:45.458143 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application Oct 13 11:00:45.458143 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 470/935] 10.222.0.18 () {56 vars in 1111 bytes} [Thu Oct 13 11:00:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 11:00:45.459340 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed89cf38-371a-44b3-8f0a-fc7e1765391a None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:00:45.536735 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:00:45.571741 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed89cf38-371a-44b3-8f0a-fc7e1765391a None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:00:45.607164 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9251fc6c-5fab-4fca-a9c9-25c03dbf5282 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:00:45.607796 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9251fc6c-5fab-4fca-a9c9-25c03dbf5282 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:00:45.608073 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9251fc6c-5fab-4fca-a9c9-25c03dbf5282 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:00:45.608342 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9251fc6c-5fab-4fca-a9c9-25c03dbf5282 None admin] PATH_INFO: `/v3/projects` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:00:45.609052 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9251fc6c-5fab-4fca-a9c9-25c03dbf5282 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 11:00:45.609361 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9251fc6c-5fab-4fca-a9c9-25c03dbf5282 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:00:45.610777 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9251fc6c-5fab-4fca-a9c9-25c03dbf5282 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:00:45.623577 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 466/936] 10.222.0.18 () {56 vars in 1148 bytes} [Thu Oct 13 11:00:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 11:00:45.629642 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fabe03ed-2250-4f28-9daa-4215add70327 None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:00:45.737719 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fabe03ed-2250-4f28-9daa-4215add70327 None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:00:45.777147 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ac15bf-3650-4405-aca9-e2fef1156b01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:00:45.777721 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ac15bf-3650-4405-aca9-e2fef1156b01 None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:00:45.777998 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ac15bf-3650-4405-aca9-e2fef1156b01 None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:00:45.778266 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ac15bf-3650-4405-aca9-e2fef1156b01 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:00:45.778986 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ac15bf-3650-4405-aca9-e2fef1156b01 None admin] RBAC: Adding query filter params (role.id=6af7358ee6934ea2830749333f35aa5c, scope.project.id=112613528384453abe7506465609fbd8, user.id=2ccb162f8c154aad96f8e71b26406337) {{(pid=81533) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 11:00:45.779299 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ac15bf-3650-4405-aca9-e2fef1156b01 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:00:45.780714 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ac15bf-3650-4405-aca9-e2fef1156b01 None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:00:45.787271 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 471/937] 10.222.0.18 () {56 vars in 1374 bytes} [Thu Oct 13 11:00:45 2022] GET /identity/v3/role_assignments?user.id=2ccb162f8c154aad96f8e71b26406337&scope.project.id=112613528384453abe7506465609fbd8&role.id=6af7358ee6934ea2830749333f35aa5c => generated 608 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 11:00:48.227635 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993368b1-e40d-47d7-9606-a10accb9344d None None] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:00:48.228191 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993368b1-e40d-47d7-9606-a10accb9344d None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:00:48.228432 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993368b1-e40d-47d7-9606-a10accb9344d None None] PATH_INFO: `/` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:00:48.229926 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 467/938] 10.222.0.18 () {54 vars in 927 bytes} [Thu Oct 13 11:00:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 11:00:48.235248 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3219c5-db8a-4f58-a957-4c1103c515d7 None None] REQUEST_METHOD: `POST` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:00:48.235797 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3219c5-db8a-4f58-a957-4c1103c515d7 None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:00:48.235797 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3219c5-db8a-4f58-a957-4c1103c515d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:00:48.255506 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.auth.core [None req-ba3219c5-db8a-4f58-a957-4c1103c515d7 None None] MFA Rules not processed for user `8ba31ade43694cf8bf28f7528a9ea179`. Rule list: `[]` (Enabled: `True`). {{(pid=81533) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 11:00:48.256974 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-ba3219c5-db8a-4f58-a957-4c1103c515d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:00:48.259957 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:00:48.329843 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 472/939] 10.222.0.18 () {58 vars in 1024 bytes} [Thu Oct 13 11:00:48 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 13 11:00:48.602978 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993368b1-e40d-47d7-9606-a10accb9344d None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:00:48.713097 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993368b1-e40d-47d7-9606-a10accb9344d None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:00:48.744816 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:00:48.751453 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee508522-96ac-4b3e-b449-5a408b0c1d1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:00:48.752554 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee508522-96ac-4b3e-b449-5a408b0c1d1a None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:00:48.752554 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee508522-96ac-4b3e-b449-5a408b0c1d1a None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:00:48.752746 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee508522-96ac-4b3e-b449-5a408b0c1d1a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:00:48.764352 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee508522-96ac-4b3e-b449-5a408b0c1d1a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 13 11:00:48.769458 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application [None req-ee508522-96ac-4b3e-b449-5a408b0c1d1a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 13 11:00:48.769458 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 11:00:48.769458 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 11:00:48.769458 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 11:00:48.769458 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 11:00:48.769458 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 11:00:48.769458 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 11:00:48.769458 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 11:00:48.769458 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 11:00:48.769458 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 11:00:48.769458 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 11:00:48.769458 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 11:00:48.769458 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 13 11:00:48.769458 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 13 11:00:48.769458 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 13 11:00:48.769458 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 13 11:00:48.770507 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 13 11:00:48.770507 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 13 11:00:48.770507 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 13 11:00:48.770507 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 13 11:00:48.770507 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 11:00:48.770507 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 11:00:48.770507 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 11:00:48.770507 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 11:00:48.770507 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 11:00:48.770507 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 11:00:48.770507 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 11:00:48.770507 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application with Lock( Oct 13 11:00:48.770507 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 11:00:48.770507 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._enter() Oct 13 11:00:48.770507 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 11:00:48.770507 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 11:00:48.772169 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 11:00:48.772169 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.creator() Oct 13 11:00:48.772169 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 11:00:48.772169 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application created_value = creator( Oct 13 11:00:48.772169 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 13 11:00:48.772169 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 13 11:00:48.772169 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 13 11:00:48.772169 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 13 11:00:48.772169 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 13 11:00:48.772169 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 13 11:00:48.772169 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 13 11:00:48.772169 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application Oct 13 11:00:48.772169 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 468/940] 10.222.0.18 () {56 vars in 1096 bytes} [Thu Oct 13 11:00:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 11:00:48.777848 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3219c5-db8a-4f58-a957-4c1103c515d7 None None] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:00:48.891757 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3219c5-db8a-4f58-a957-4c1103c515d7 None None] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:00:48.931700 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8d8598-dcb5-4cdf-bba8-f1f626f3980c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:00:48.932338 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8d8598-dcb5-4cdf-bba8-f1f626f3980c None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:00:48.932628 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8d8598-dcb5-4cdf-bba8-f1f626f3980c None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:00:48.932898 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8d8598-dcb5-4cdf-bba8-f1f626f3980c None admin] PATH_INFO: `/v3/roles` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:00:48.933655 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8d8598-dcb5-4cdf-bba8-f1f626f3980c None admin] RBAC: Adding query filter params (name=admin) {{(pid=81533) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 11:00:48.934001 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8d8598-dcb5-4cdf-bba8-f1f626f3980c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:00:48.935519 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8d8598-dcb5-4cdf-bba8-f1f626f3980c None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:00:48.945158 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 473/941] 10.222.0.18 () {56 vars in 1099 bytes} [Thu Oct 13 11:00:48 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 11:00:48.951036 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee508522-96ac-4b3e-b449-5a408b0c1d1a None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:00:49.060091 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee508522-96ac-4b3e-b449-5a408b0c1d1a None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:00:49.095852 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d71d439-bc43-4db5-9388-5db7b3915cea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:00:49.096476 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d71d439-bc43-4db5-9388-5db7b3915cea None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:00:49.096751 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d71d439-bc43-4db5-9388-5db7b3915cea None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:00:49.097038 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d71d439-bc43-4db5-9388-5db7b3915cea None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:00:49.109236 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d71d439-bc43-4db5-9388-5db7b3915cea None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:00:49.110742 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d71d439-bc43-4db5-9388-5db7b3915cea None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:00:49.127415 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application [None req-0d71d439-bc43-4db5-9388-5db7b3915cea None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 13 11:00:49.127415 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 11:00:49.127415 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 11:00:49.127415 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 11:00:49.127415 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 11:00:49.127415 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 11:00:49.127415 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 11:00:49.127415 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 11:00:49.127415 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 11:00:49.127415 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 11:00:49.127415 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 11:00:49.127415 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 11:00:49.127415 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 13 11:00:49.127415 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 13 11:00:49.127415 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 13 11:00:49.127415 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 13 11:00:49.128616 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 11:00:49.128616 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 11:00:49.128616 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 11:00:49.128616 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 11:00:49.128616 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 11:00:49.128616 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 11:00:49.128616 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 11:00:49.128616 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application with Lock( Oct 13 11:00:49.128616 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 11:00:49.128616 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._enter() Oct 13 11:00:49.128616 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 11:00:49.128616 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 11:00:49.128616 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 11:00:49.128616 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.creator() Oct 13 11:00:49.128616 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 11:00:49.128616 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application created_value = creator( Oct 13 11:00:49.128616 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 13 11:00:49.129820 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 13 11:00:49.129820 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 13 11:00:49.129820 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application Oct 13 11:00:49.129820 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 469/942] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Oct 13 11:00:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 13 11:00:49.134763 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8d8598-dcb5-4cdf-bba8-f1f626f3980c None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:00:49.138009 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:00:49.242811 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8d8598-dcb5-4cdf-bba8-f1f626f3980c None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:00:49.279586 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2896ce-8129-4e21-b457-8f19ed118541 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:00:49.280219 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2896ce-8129-4e21-b457-8f19ed118541 None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:00:49.280523 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2896ce-8129-4e21-b457-8f19ed118541 None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:00:49.280827 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2896ce-8129-4e21-b457-8f19ed118541 None admin] PATH_INFO: `/v3/domains` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:00:49.281560 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2896ce-8129-4e21-b457-8f19ed118541 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81533) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 11:00:49.281915 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2896ce-8129-4e21-b457-8f19ed118541 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:00:49.283396 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2896ce-8129-4e21-b457-8f19ed118541 None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:00:49.296357 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 474/943] 10.222.0.18 () {56 vars in 1109 bytes} [Thu Oct 13 11:00:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 11:00:49.302557 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d71d439-bc43-4db5-9388-5db7b3915cea None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:00:49.350650 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:00:49.412844 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d71d439-bc43-4db5-9388-5db7b3915cea None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:00:49.449695 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6fbffd6-d1d1-47b8-9605-a6a453e059af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:00:49.450467 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fbffd6-d1d1-47b8-9605-a6a453e059af None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:00:49.450793 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fbffd6-d1d1-47b8-9605-a6a453e059af None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:00:49.451157 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fbffd6-d1d1-47b8-9605-a6a453e059af None admin] PATH_INFO: `/v3/users/placement` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:00:49.461326 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6fbffd6-d1d1-47b8-9605-a6a453e059af None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:00:49.463232 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6fbffd6-d1d1-47b8-9605-a6a453e059af None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:00:49.477064 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application [None req-a6fbffd6-d1d1-47b8-9605-a6a453e059af None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Oct 13 11:00:49.477064 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 11:00:49.477064 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 11:00:49.477064 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 11:00:49.477064 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 11:00:49.477064 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 11:00:49.477064 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 11:00:49.477064 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 11:00:49.477064 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 11:00:49.477064 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 11:00:49.477064 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 11:00:49.477064 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 11:00:49.477064 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 13 11:00:49.477064 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 13 11:00:49.477064 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 13 11:00:49.477064 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 13 11:00:49.478039 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 11:00:49.478039 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 11:00:49.478039 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 13 11:00:49.478039 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 13 11:00:49.478039 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 13 11:00:49.478039 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 13 11:00:49.478039 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 11:00:49.478039 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 11:00:49.478039 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 11:00:49.478039 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 11:00:49.478039 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 11:00:49.478039 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application with Lock( Oct 13 11:00:49.478039 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 11:00:49.478039 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._enter() Oct 13 11:00:49.478039 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 11:00:49.478039 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 11:00:49.478039 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 11:00:49.478039 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.creator() Oct 13 11:00:49.478981 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 11:00:49.478981 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application created_value = creator( Oct 13 11:00:49.478981 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 13 11:00:49.478981 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 13 11:00:49.478981 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 13 11:00:49.478981 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 13 11:00:49.478981 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 13 11:00:49.478981 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 13 11:00:49.478981 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Oct 13 11:00:49.478981 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application Oct 13 11:00:49.480821 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 470/944] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Oct 13 11:00:49 2022] GET /identity/v3/users/placement => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 11:00:49.487061 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2896ce-8129-4e21-b457-8f19ed118541 None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:00:49.553068 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:00:49.595619 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2896ce-8129-4e21-b457-8f19ed118541 None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:00:49.632517 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020a7291-6cc6-4304-b6f8-b3c874e2e20a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:00:49.633155 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020a7291-6cc6-4304-b6f8-b3c874e2e20a None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:00:49.633429 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020a7291-6cc6-4304-b6f8-b3c874e2e20a None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:00:49.633697 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020a7291-6cc6-4304-b6f8-b3c874e2e20a None admin] PATH_INFO: `/v3/users` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:00:49.634476 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020a7291-6cc6-4304-b6f8-b3c874e2e20a None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81533) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 11:00:49.634754 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020a7291-6cc6-4304-b6f8-b3c874e2e20a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:00:49.636715 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020a7291-6cc6-4304-b6f8-b3c874e2e20a None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:00:49.657516 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 475/945] 10.222.0.18 () {56 vars in 1143 bytes} [Thu Oct 13 11:00:49 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 11:00:49.664380 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6fbffd6-d1d1-47b8-9605-a6a453e059af None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:00:49.780314 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6fbffd6-d1d1-47b8-9605-a6a453e059af None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:00:49.782395 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:00:49.820829 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecdc1ad0-69fd-49b8-b147-f8a10998e41b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:00:49.821471 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdc1ad0-69fd-49b8-b147-f8a10998e41b None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:00:49.821799 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdc1ad0-69fd-49b8-b147-f8a10998e41b None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:00:49.822076 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdc1ad0-69fd-49b8-b147-f8a10998e41b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:00:49.832701 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecdc1ad0-69fd-49b8-b147-f8a10998e41b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:00:49.834967 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecdc1ad0-69fd-49b8-b147-f8a10998e41b None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:00:49.850964 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application [None req-ecdc1ad0-69fd-49b8-b147-f8a10998e41b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 13 11:00:49.850964 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 11:00:49.850964 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 11:00:49.850964 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 11:00:49.850964 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 11:00:49.850964 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 11:00:49.850964 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 11:00:49.850964 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 11:00:49.850964 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 11:00:49.850964 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 11:00:49.850964 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 11:00:49.850964 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 11:00:49.850964 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 13 11:00:49.850964 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 13 11:00:49.850964 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 13 11:00:49.850964 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 13 11:00:49.852171 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 11:00:49.852171 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 11:00:49.852171 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 11:00:49.852171 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 11:00:49.852171 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 11:00:49.852171 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 11:00:49.852171 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 11:00:49.852171 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application with Lock( Oct 13 11:00:49.852171 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 11:00:49.852171 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._enter() Oct 13 11:00:49.852171 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 11:00:49.852171 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 11:00:49.852171 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 11:00:49.852171 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.creator() Oct 13 11:00:49.852171 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 11:00:49.852171 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application created_value = creator( Oct 13 11:00:49.852171 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 13 11:00:49.853367 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 13 11:00:49.853367 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 13 11:00:49.853367 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application Oct 13 11:00:49.853367 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 471/946] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Oct 13 11:00:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 13 11:00:49.858144 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020a7291-6cc6-4304-b6f8-b3c874e2e20a None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:00:49.982946 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020a7291-6cc6-4304-b6f8-b3c874e2e20a None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:00:50.007421 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:00:50.023313 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb73937-1194-44d0-8b67-c984c1819aaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:00:50.023921 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb73937-1194-44d0-8b67-c984c1819aaa None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:00:50.024265 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb73937-1194-44d0-8b67-c984c1819aaa None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:00:50.024580 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb73937-1194-44d0-8b67-c984c1819aaa None admin] PATH_INFO: `/v3/domains` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:00:50.025262 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb73937-1194-44d0-8b67-c984c1819aaa None admin] RBAC: Adding query filter params (name=Default) {{(pid=81533) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 11:00:50.025565 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb73937-1194-44d0-8b67-c984c1819aaa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:00:50.026937 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb73937-1194-44d0-8b67-c984c1819aaa None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:00:50.039147 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 476/947] 10.222.0.18 () {56 vars in 1109 bytes} [Thu Oct 13 11:00:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 13 11:00:50.044893 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecdc1ad0-69fd-49b8-b147-f8a10998e41b None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:00:50.155669 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecdc1ad0-69fd-49b8-b147-f8a10998e41b None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:00:50.198705 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70bba1b5-8580-4a8e-8cfd-9b429ad16962 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:00:50.199336 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bba1b5-8580-4a8e-8cfd-9b429ad16962 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:00:50.199617 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bba1b5-8580-4a8e-8cfd-9b429ad16962 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:00:50.199903 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bba1b5-8580-4a8e-8cfd-9b429ad16962 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:00:50.207941 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70bba1b5-8580-4a8e-8cfd-9b429ad16962 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:00:50.210248 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70bba1b5-8580-4a8e-8cfd-9b429ad16962 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:00:50.222770 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application [None req-70bba1b5-8580-4a8e-8cfd-9b429ad16962 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 13 11:00:50.222770 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 11:00:50.222770 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 11:00:50.222770 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 11:00:50.222770 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 11:00:50.222770 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 11:00:50.222770 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 11:00:50.222770 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 11:00:50.222770 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 11:00:50.222770 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 11:00:50.222770 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 11:00:50.222770 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 11:00:50.222770 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 13 11:00:50.222770 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 13 11:00:50.222770 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 13 11:00:50.223856 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 13 11:00:50.223856 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 11:00:50.223856 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 11:00:50.223856 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 11:00:50.223856 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 11:00:50.223856 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 11:00:50.223856 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 11:00:50.223856 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 11:00:50.223856 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application with Lock( Oct 13 11:00:50.223856 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 11:00:50.223856 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._enter() Oct 13 11:00:50.223856 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 11:00:50.223856 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 11:00:50.223856 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 11:00:50.223856 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.creator() Oct 13 11:00:50.223856 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 11:00:50.223856 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application created_value = creator( Oct 13 11:00:50.225869 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 13 11:00:50.225869 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 13 11:00:50.225869 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 13 11:00:50.225869 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 13 11:00:50.225869 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 13 11:00:50.225869 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 13 11:00:50.225869 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 13 11:00:50.225869 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application Oct 13 11:00:50.225869 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 472/948] 10.222.0.18 () {56 vars in 1111 bytes} [Thu Oct 13 11:00:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 13 11:00:50.230606 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb73937-1194-44d0-8b67-c984c1819aaa None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:00:50.339057 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb73937-1194-44d0-8b67-c984c1819aaa None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:00:50.376637 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25909d96-cc46-490e-996a-1d3809a676dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:00:50.377321 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25909d96-cc46-490e-996a-1d3809a676dd None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:00:50.377643 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25909d96-cc46-490e-996a-1d3809a676dd None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:00:50.377940 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25909d96-cc46-490e-996a-1d3809a676dd None admin] PATH_INFO: `/v3/projects` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:00:50.378625 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25909d96-cc46-490e-996a-1d3809a676dd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81533) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 11:00:50.378987 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25909d96-cc46-490e-996a-1d3809a676dd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:00:50.380499 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25909d96-cc46-490e-996a-1d3809a676dd None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:00:50.394443 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 477/949] 10.222.0.18 () {56 vars in 1148 bytes} [Thu Oct 13 11:00:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 13 11:00:50.402178 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70bba1b5-8580-4a8e-8cfd-9b429ad16962 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:00:50.420485 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:00:50.516731 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70bba1b5-8580-4a8e-8cfd-9b429ad16962 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:00:50.550998 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13c4aae-b504-4838-b77c-a2114575fc8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:00:50.551631 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13c4aae-b504-4838-b77c-a2114575fc8a None admin] REQUEST_METHOD: `PUT` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:00:50.551912 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13c4aae-b504-4838-b77c-a2114575fc8a None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:00:50.552206 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13c4aae-b504-4838-b77c-a2114575fc8a None admin] PATH_INFO: `/v3/projects/112613528384453abe7506465609fbd8/users/2ccb162f8c154aad96f8e71b26406337/roles/30a6d59262144d4d956f4d4207864030` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:00:50.554722 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13c4aae-b504-4838-b77c-a2114575fc8a None admin] RBAC: Authorizing `identity:create_grant(project_id=112613528384453abe7506465609fbd8, user_id=2ccb162f8c154aad96f8e71b26406337, role_id=30a6d59262144d4d956f4d4207864030)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:00:50.556166 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13c4aae-b504-4838-b77c-a2114575fc8a None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:00:50.568726 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 473/950] 10.222.0.18 () {58 vars in 1439 bytes} [Thu Oct 13 11:00:50 2022] PUT /identity/v3/projects/112613528384453abe7506465609fbd8/users/2ccb162f8c154aad96f8e71b26406337/roles/30a6d59262144d4d956f4d4207864030 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 11:00:52.757092 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3880850f-ebea-4d86-871d-14f808e69ed5 None None] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:00:52.757604 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3880850f-ebea-4d86-871d-14f808e69ed5 None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:00:52.757699 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3880850f-ebea-4d86-871d-14f808e69ed5 None None] PATH_INFO: `/` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:00:52.758976 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 478/951] 10.222.0.18 () {54 vars in 927 bytes} [Thu Oct 13 11:00:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 11:00:52.764571 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cda3ce4-4e93-41a2-9b87-1f212eb475de None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:00:52.765038 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cda3ce4-4e93-41a2-9b87-1f212eb475de None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:00:52.765135 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cda3ce4-4e93-41a2-9b87-1f212eb475de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:00:52.783183 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-0cda3ce4-4e93-41a2-9b87-1f212eb475de None None] MFA Rules not processed for user `8ba31ade43694cf8bf28f7528a9ea179`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 11:00:52.784371 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-0cda3ce4-4e93-41a2-9b87-1f212eb475de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:00:52.853760 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 474/952] 10.222.0.18 () {58 vars in 1024 bytes} [Thu Oct 13 11:00:52 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 13 11:00:53.126397 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3880850f-ebea-4d86-871d-14f808e69ed5 None None] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:00:53.173581 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:00:53.238250 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3880850f-ebea-4d86-871d-14f808e69ed5 None None] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:00:53.276643 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea8e43a-f7bf-4363-a93f-11f6523ccfa9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:00:53.277296 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea8e43a-f7bf-4363-a93f-11f6523ccfa9 None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:00:53.277571 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea8e43a-f7bf-4363-a93f-11f6523ccfa9 None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:00:53.277841 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea8e43a-f7bf-4363-a93f-11f6523ccfa9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:00:53.288314 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea8e43a-f7bf-4363-a93f-11f6523ccfa9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 13 11:00:53.293303 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application [None req-3ea8e43a-f7bf-4363-a93f-11f6523ccfa9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 13 11:00:53.293303 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 11:00:53.293303 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 11:00:53.293303 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 11:00:53.293303 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 11:00:53.293303 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 11:00:53.293303 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 11:00:53.293303 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 11:00:53.293303 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 11:00:53.293303 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 11:00:53.293303 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 11:00:53.293303 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 11:00:53.293303 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 13 11:00:53.293303 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 13 11:00:53.293303 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 13 11:00:53.293303 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 13 11:00:53.294404 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 13 11:00:53.294404 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 13 11:00:53.294404 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 13 11:00:53.294404 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 13 11:00:53.294404 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 11:00:53.294404 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 11:00:53.294404 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 11:00:53.294404 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 11:00:53.294404 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 11:00:53.294404 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 11:00:53.294404 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 11:00:53.294404 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application with Lock( Oct 13 11:00:53.294404 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 11:00:53.294404 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._enter() Oct 13 11:00:53.294404 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 11:00:53.294404 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 11:00:53.295400 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 11:00:53.295400 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.creator() Oct 13 11:00:53.295400 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 11:00:53.295400 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application created_value = creator( Oct 13 11:00:53.295400 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 13 11:00:53.295400 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 13 11:00:53.295400 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 13 11:00:53.295400 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 13 11:00:53.295400 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 13 11:00:53.295400 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 13 11:00:53.295400 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 13 11:00:53.295400 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application Oct 13 11:00:53.295400 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 479/953] 10.222.0.18 () {56 vars in 1096 bytes} [Thu Oct 13 11:00:53 2022] GET /identity/v3/roles/admin => generated 83 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 13 11:00:53.300905 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cda3ce4-4e93-41a2-9b87-1f212eb475de None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:00:53.304581 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:00:53.410823 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cda3ce4-4e93-41a2-9b87-1f212eb475de None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:00:53.451880 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce747fe-6b82-414d-998f-399b56b5e801 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:00:53.452506 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce747fe-6b82-414d-998f-399b56b5e801 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:00:53.452802 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce747fe-6b82-414d-998f-399b56b5e801 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:00:53.453165 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce747fe-6b82-414d-998f-399b56b5e801 None admin] PATH_INFO: `/v3/roles` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:00:53.453944 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce747fe-6b82-414d-998f-399b56b5e801 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 11:00:53.454253 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce747fe-6b82-414d-998f-399b56b5e801 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:00:53.455746 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce747fe-6b82-414d-998f-399b56b5e801 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:00:53.466647 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 475/954] 10.222.0.18 () {56 vars in 1099 bytes} [Thu Oct 13 11:00:53 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 11:00:53.473731 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea8e43a-f7bf-4363-a93f-11f6523ccfa9 None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:00:53.589486 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:00:53.592544 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea8e43a-f7bf-4363-a93f-11f6523ccfa9 None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:00:53.630293 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ff6f42-aad4-4eb3-83a3-a35bf2aa4f77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:00:53.631493 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ff6f42-aad4-4eb3-83a3-a35bf2aa4f77 None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:00:53.631805 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ff6f42-aad4-4eb3-83a3-a35bf2aa4f77 None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:00:53.632140 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ff6f42-aad4-4eb3-83a3-a35bf2aa4f77 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:00:53.642830 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ff6f42-aad4-4eb3-83a3-a35bf2aa4f77 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:00:53.644275 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ff6f42-aad4-4eb3-83a3-a35bf2aa4f77 None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:00:53.661084 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application [None req-f7ff6f42-aad4-4eb3-83a3-a35bf2aa4f77 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 13 11:00:53.661084 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 11:00:53.661084 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 11:00:53.661084 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 11:00:53.661084 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 11:00:53.661084 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 11:00:53.661084 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 11:00:53.661084 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 11:00:53.661084 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 11:00:53.661084 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 11:00:53.661084 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 11:00:53.661084 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 11:00:53.661084 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 13 11:00:53.661084 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 13 11:00:53.661084 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 13 11:00:53.661084 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 13 11:00:53.662333 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 11:00:53.662333 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 11:00:53.662333 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 11:00:53.662333 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 11:00:53.662333 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 11:00:53.662333 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 11:00:53.662333 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 11:00:53.662333 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application with Lock( Oct 13 11:00:53.662333 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 11:00:53.662333 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._enter() Oct 13 11:00:53.662333 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 11:00:53.662333 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 11:00:53.662333 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 11:00:53.662333 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.creator() Oct 13 11:00:53.662333 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 11:00:53.662333 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application created_value = creator( Oct 13 11:00:53.662333 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 13 11:00:53.663399 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 13 11:00:53.663399 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 13 11:00:53.663399 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application Oct 13 11:00:53.663399 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 480/955] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Oct 13 11:00:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 11:00:53.669672 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce747fe-6b82-414d-998f-399b56b5e801 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:00:53.745372 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:00:53.784958 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce747fe-6b82-414d-998f-399b56b5e801 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:00:53.827183 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a68738f-b9cd-4753-bd16-76b8f128eb75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:00:53.827969 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a68738f-b9cd-4753-bd16-76b8f128eb75 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:00:53.828329 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a68738f-b9cd-4753-bd16-76b8f128eb75 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:00:53.828722 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a68738f-b9cd-4753-bd16-76b8f128eb75 None admin] PATH_INFO: `/v3/domains` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:00:53.829420 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a68738f-b9cd-4753-bd16-76b8f128eb75 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 11:00:53.829755 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a68738f-b9cd-4753-bd16-76b8f128eb75 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:00:53.831433 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a68738f-b9cd-4753-bd16-76b8f128eb75 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:00:53.845890 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 476/956] 10.222.0.18 () {56 vars in 1109 bytes} [Thu Oct 13 11:00:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 11:00:53.852178 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ff6f42-aad4-4eb3-83a3-a35bf2aa4f77 None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:00:53.963152 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ff6f42-aad4-4eb3-83a3-a35bf2aa4f77 None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:00:53.999225 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7265421f-51e6-4d61-8bbf-1980a4d54431 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:00:53.999882 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7265421f-51e6-4d61-8bbf-1980a4d54431 None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:00:54.000164 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7265421f-51e6-4d61-8bbf-1980a4d54431 None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:00:54.000441 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7265421f-51e6-4d61-8bbf-1980a4d54431 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:00:54.009672 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7265421f-51e6-4d61-8bbf-1980a4d54431 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:00:54.011403 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7265421f-51e6-4d61-8bbf-1980a4d54431 None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:00:54.023703 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application [None req-7265421f-51e6-4d61-8bbf-1980a4d54431 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Oct 13 11:00:54.023703 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 11:00:54.023703 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 11:00:54.023703 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 11:00:54.023703 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 11:00:54.023703 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 11:00:54.023703 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 11:00:54.023703 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 11:00:54.023703 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 11:00:54.023703 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 11:00:54.023703 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 11:00:54.023703 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 11:00:54.023703 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 13 11:00:54.023703 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 13 11:00:54.023703 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 13 11:00:54.023703 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 13 11:00:54.024933 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 11:00:54.024933 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 11:00:54.024933 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 13 11:00:54.024933 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 13 11:00:54.024933 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 13 11:00:54.024933 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 13 11:00:54.024933 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 11:00:54.024933 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 11:00:54.024933 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 11:00:54.024933 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 11:00:54.024933 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 11:00:54.024933 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application with Lock( Oct 13 11:00:54.024933 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 11:00:54.024933 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._enter() Oct 13 11:00:54.024933 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 11:00:54.024933 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 11:00:54.024933 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 11:00:54.024933 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.creator() Oct 13 11:00:54.025972 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 11:00:54.025972 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application created_value = creator( Oct 13 11:00:54.025972 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 13 11:00:54.025972 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 13 11:00:54.025972 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 13 11:00:54.025972 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 13 11:00:54.025972 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 13 11:00:54.025972 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 13 11:00:54.025972 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Oct 13 11:00:54.025972 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application Oct 13 11:00:54.025972 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 481/957] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Oct 13 11:00:53 2022] GET /identity/v3/users/placement => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 11:00:54.031099 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a68738f-b9cd-4753-bd16-76b8f128eb75 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:00:54.136255 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a68738f-b9cd-4753-bd16-76b8f128eb75 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:00:54.163590 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:00:54.172808 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b831d7-344e-41ed-8e37-cde96d7774f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:00:54.173463 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b831d7-344e-41ed-8e37-cde96d7774f9 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:00:54.173747 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b831d7-344e-41ed-8e37-cde96d7774f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:00:54.174024 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b831d7-344e-41ed-8e37-cde96d7774f9 None admin] PATH_INFO: `/v3/users` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:00:54.174769 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b831d7-344e-41ed-8e37-cde96d7774f9 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 11:00:54.175077 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b831d7-344e-41ed-8e37-cde96d7774f9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:00:54.176524 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b831d7-344e-41ed-8e37-cde96d7774f9 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:00:54.197095 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 477/958] 10.222.0.18 () {56 vars in 1143 bytes} [Thu Oct 13 11:00:54 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 11:00:54.203103 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7265421f-51e6-4d61-8bbf-1980a4d54431 None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:00:54.220169 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:00:54.309843 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7265421f-51e6-4d61-8bbf-1980a4d54431 None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:00:54.343825 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72748c56-cab9-4766-bf80-7ae11fc3f9b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:00:54.344442 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72748c56-cab9-4766-bf80-7ae11fc3f9b0 None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:00:54.344724 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72748c56-cab9-4766-bf80-7ae11fc3f9b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:00:54.344997 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72748c56-cab9-4766-bf80-7ae11fc3f9b0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:00:54.416867 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72748c56-cab9-4766-bf80-7ae11fc3f9b0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:00:54.418343 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72748c56-cab9-4766-bf80-7ae11fc3f9b0 None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:00:54.432405 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:00:54.531975 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 482/959] 10.222.0.18 () {58 vars in 1282 bytes} [Thu Oct 13 11:00:54 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Oct 13 11:00:54.538275 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b831d7-344e-41ed-8e37-cde96d7774f9 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:00:54.633771 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b831d7-344e-41ed-8e37-cde96d7774f9 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:00:54.667306 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5b24f5-82aa-483f-be96-bc2c5e4eedb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:00:54.667924 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5b24f5-82aa-483f-be96-bc2c5e4eedb4 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:00:54.668204 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5b24f5-82aa-483f-be96-bc2c5e4eedb4 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:00:54.668476 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5b24f5-82aa-483f-be96-bc2c5e4eedb4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:00:54.678242 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5b24f5-82aa-483f-be96-bc2c5e4eedb4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:00:54.679730 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5b24f5-82aa-483f-be96-bc2c5e4eedb4 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:00:54.694076 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application [None req-7b5b24f5-82aa-483f-be96-bc2c5e4eedb4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 13 11:00:54.694076 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 11:00:54.694076 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 11:00:54.694076 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 11:00:54.694076 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 11:00:54.694076 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 11:00:54.694076 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 11:00:54.694076 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 11:00:54.694076 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 11:00:54.694076 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 11:00:54.694076 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 11:00:54.694076 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 11:00:54.694076 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 13 11:00:54.694076 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 13 11:00:54.694076 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 13 11:00:54.694076 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 13 11:00:54.695152 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 11:00:54.695152 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 11:00:54.695152 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 11:00:54.695152 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 11:00:54.695152 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 11:00:54.695152 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 11:00:54.695152 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 11:00:54.695152 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application with Lock( Oct 13 11:00:54.695152 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 11:00:54.695152 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._enter() Oct 13 11:00:54.695152 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 11:00:54.695152 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 11:00:54.695152 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 11:00:54.695152 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.creator() Oct 13 11:00:54.695152 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 11:00:54.695152 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application created_value = creator( Oct 13 11:00:54.695152 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 13 11:00:54.696068 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 13 11:00:54.696068 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 13 11:00:54.696068 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application Oct 13 11:00:54.696068 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 478/960] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Oct 13 11:00:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 11:00:54.700982 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72748c56-cab9-4766-bf80-7ae11fc3f9b0 None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:00:54.798927 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72748c56-cab9-4766-bf80-7ae11fc3f9b0 None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:00:54.811588 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:00:54.832248 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc7f1f5-dc7b-42b6-b489-5bdc50b6b143 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:00:54.832845 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc7f1f5-dc7b-42b6-b489-5bdc50b6b143 None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:00:54.833161 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc7f1f5-dc7b-42b6-b489-5bdc50b6b143 None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:00:54.833437 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc7f1f5-dc7b-42b6-b489-5bdc50b6b143 None admin] PATH_INFO: `/v3/domains` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:00:54.834605 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc7f1f5-dc7b-42b6-b489-5bdc50b6b143 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81533) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 11:00:54.834903 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc7f1f5-dc7b-42b6-b489-5bdc50b6b143 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:00:54.836265 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc7f1f5-dc7b-42b6-b489-5bdc50b6b143 None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:00:54.847116 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 483/961] 10.222.0.18 () {56 vars in 1109 bytes} [Thu Oct 13 11:00:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 11:00:54.853542 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5b24f5-82aa-483f-be96-bc2c5e4eedb4 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:00:54.888083 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:00:54.952598 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5b24f5-82aa-483f-be96-bc2c5e4eedb4 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:00:54.985599 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c7ff71-8ab5-49c6-8d58-a1cd409f2a72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:00:54.986213 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c7ff71-8ab5-49c6-8d58-a1cd409f2a72 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:00:54.986491 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c7ff71-8ab5-49c6-8d58-a1cd409f2a72 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:00:54.986759 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c7ff71-8ab5-49c6-8d58-a1cd409f2a72 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:00:54.993220 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c7ff71-8ab5-49c6-8d58-a1cd409f2a72 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:00:54.994640 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c7ff71-8ab5-49c6-8d58-a1cd409f2a72 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:00:55.005479 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application [None req-94c7ff71-8ab5-49c6-8d58-a1cd409f2a72 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 13 11:00:55.005479 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 11:00:55.005479 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 11:00:55.005479 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 11:00:55.005479 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 11:00:55.005479 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 11:00:55.005479 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 11:00:55.005479 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 11:00:55.005479 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 11:00:55.005479 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 11:00:55.005479 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 11:00:55.005479 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 11:00:55.005479 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 13 11:00:55.005479 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 13 11:00:55.005479 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 13 11:00:55.007012 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 13 11:00:55.007012 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 11:00:55.007012 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 11:00:55.007012 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 11:00:55.007012 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 11:00:55.007012 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 11:00:55.007012 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 11:00:55.007012 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 11:00:55.007012 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application with Lock( Oct 13 11:00:55.007012 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 11:00:55.007012 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._enter() Oct 13 11:00:55.007012 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 11:00:55.007012 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 11:00:55.007012 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 11:00:55.007012 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.creator() Oct 13 11:00:55.007012 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 11:00:55.007012 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application created_value = creator( Oct 13 11:00:55.012505 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 13 11:00:55.012505 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 13 11:00:55.012505 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 13 11:00:55.012505 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 13 11:00:55.012505 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 13 11:00:55.012505 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 13 11:00:55.012505 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 13 11:00:55.012505 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: ERROR keystone.server.flask.application Oct 13 11:00:55.012505 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 479/962] 10.222.0.18 () {56 vars in 1111 bytes} [Thu Oct 13 11:00:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 11:00:55.013392 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc7f1f5-dc7b-42b6-b489-5bdc50b6b143 None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:00:55.110199 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc7f1f5-dc7b-42b6-b489-5bdc50b6b143 None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:00:55.147176 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722b099b-e684-427a-9a2c-abc5bbbecda3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:00:55.147921 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722b099b-e684-427a-9a2c-abc5bbbecda3 None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:00:55.148200 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722b099b-e684-427a-9a2c-abc5bbbecda3 None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:00:55.148472 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722b099b-e684-427a-9a2c-abc5bbbecda3 None admin] PATH_INFO: `/v3/projects` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:00:55.149177 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-722b099b-e684-427a-9a2c-abc5bbbecda3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81533) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 11:00:55.149484 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-722b099b-e684-427a-9a2c-abc5bbbecda3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:00:55.150902 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-722b099b-e684-427a-9a2c-abc5bbbecda3 None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:00:55.162792 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 484/963] 10.222.0.18 () {56 vars in 1148 bytes} [Thu Oct 13 11:00:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 11:00:55.168901 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c7ff71-8ab5-49c6-8d58-a1cd409f2a72 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:00:55.258822 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:00:55.265165 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c7ff71-8ab5-49c6-8d58-a1cd409f2a72 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:00:55.297286 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f46391-9ba0-436c-8a0f-2e4fc7577b6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:00:55.297867 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f46391-9ba0-436c-8a0f-2e4fc7577b6a None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:00:55.298138 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f46391-9ba0-436c-8a0f-2e4fc7577b6a None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:00:55.298403 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f46391-9ba0-436c-8a0f-2e4fc7577b6a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:00:55.299108 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f46391-9ba0-436c-8a0f-2e4fc7577b6a None admin] RBAC: Adding query filter params (role.id=30a6d59262144d4d956f4d4207864030, scope.project.id=112613528384453abe7506465609fbd8, user.id=2ccb162f8c154aad96f8e71b26406337) {{(pid=81534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 11:00:55.299409 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f46391-9ba0-436c-8a0f-2e4fc7577b6a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:00:55.300812 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f46391-9ba0-436c-8a0f-2e4fc7577b6a None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:00:55.306962 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 480/964] 10.222.0.18 () {56 vars in 1374 bytes} [Thu Oct 13 11:00:55 2022] GET /identity/v3/role_assignments?user.id=2ccb162f8c154aad96f8e71b26406337&scope.project.id=112613528384453abe7506465609fbd8&role.id=30a6d59262144d4d956f4d4207864030 => generated 608 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 11:00:57.469556 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c45ad48-6b66-4056-90e7-7fe31c6744fe None None] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:00:57.470118 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c45ad48-6b66-4056-90e7-7fe31c6744fe None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:00:57.470118 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c45ad48-6b66-4056-90e7-7fe31c6744fe None None] PATH_INFO: `/` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:00:57.471461 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 485/965] 10.222.0.18 () {54 vars in 927 bytes} [Thu Oct 13 11:00:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 11:00:57.477369 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78c3c02-2723-43b5-82e3-7863e7b78504 None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:00:57.477868 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78c3c02-2723-43b5-82e3-7863e7b78504 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:00:57.477868 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78c3c02-2723-43b5-82e3-7863e7b78504 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:00:57.497671 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-f78c3c02-2723-43b5-82e3-7863e7b78504 None None] MFA Rules not processed for user `8ba31ade43694cf8bf28f7528a9ea179`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 11:00:57.498852 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-f78c3c02-2723-43b5-82e3-7863e7b78504 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:00:57.563890 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 481/966] 10.222.0.18 () {58 vars in 1024 bytes} [Thu Oct 13 11:00:57 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 13 11:00:57.829452 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c45ad48-6b66-4056-90e7-7fe31c6744fe None None] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:00:57.859622 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:00:57.929079 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c45ad48-6b66-4056-90e7-7fe31c6744fe None None] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:00:57.962101 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f82010-07bc-459b-9186-e7a2a45b3483 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:00:57.962712 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f82010-07bc-459b-9186-e7a2a45b3483 None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:00:57.962991 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f82010-07bc-459b-9186-e7a2a45b3483 None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:00:57.963263 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f82010-07bc-459b-9186-e7a2a45b3483 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:00:57.963842 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f82010-07bc-459b-9186-e7a2a45b3483 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:00:57.965232 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f82010-07bc-459b-9186-e7a2a45b3483 None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:00:57.973824 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application [None req-98f82010-07bc-459b-9186-e7a2a45b3483 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Oct 13 11:00:57.973824 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 11:00:57.973824 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 13 11:00:57.973824 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 13 11:00:57.973824 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 13 11:00:57.973824 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 13 11:00:57.973824 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 13 11:00:57.973824 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 13 11:00:57.973824 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 13 11:00:57.973824 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application Oct 13 11:00:57.973824 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 13 11:00:57.973824 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application Oct 13 11:00:57.973824 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 11:00:57.973824 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 11:00:57.973824 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 11:00:57.973824 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 11:00:57.973824 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 11:00:57.976069 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 11:00:57.976069 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 11:00:57.976069 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 11:00:57.976069 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 11:00:57.976069 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 11:00:57.976069 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 11:00:57.976069 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 13 11:00:57.976069 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 13 11:00:57.976069 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 13 11:00:57.976069 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 13 11:00:57.976069 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 11:00:57.976069 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 11:00:57.976069 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 11:00:57.976069 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 11:00:57.976069 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 11:00:57.976069 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 11:00:57.977252 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 11:00:57.977252 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application with Lock( Oct 13 11:00:57.977252 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 11:00:57.977252 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._enter() Oct 13 11:00:57.977252 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 11:00:57.977252 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 11:00:57.977252 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 11:00:57.977252 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.creator() Oct 13 11:00:57.977252 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 11:00:57.977252 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application created_value = creator( Oct 13 11:00:57.977252 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 13 11:00:57.977252 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 13 11:00:57.977252 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 13 11:00:57.977252 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application Oct 13 11:00:57.977252 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 486/967] 10.222.0.18 () {56 vars in 1117 bytes} [Thu Oct 13 11:00:57 2022] GET /identity/v3/services/placement => generated 90 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 11:00:57.981563 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78c3c02-2723-43b5-82e3-7863e7b78504 None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:00:58.067426 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:00:58.076829 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78c3c02-2723-43b5-82e3-7863e7b78504 None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:00:58.109349 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1579e9a4-4287-4386-a283-5cb1409f3353 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:00:58.109935 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1579e9a4-4287-4386-a283-5cb1409f3353 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:00:58.110210 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1579e9a4-4287-4386-a283-5cb1409f3353 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:00:58.110479 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1579e9a4-4287-4386-a283-5cb1409f3353 None admin] PATH_INFO: `/v3/services` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:00:58.111099 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1579e9a4-4287-4386-a283-5cb1409f3353 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 11:00:58.111398 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1579e9a4-4287-4386-a283-5cb1409f3353 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:00:58.112752 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1579e9a4-4287-4386-a283-5cb1409f3353 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:00:58.117449 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 482/968] 10.222.0.18 () {56 vars in 1116 bytes} [Thu Oct 13 11:00:57 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 13 11:00:58.123047 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f82010-07bc-459b-9186-e7a2a45b3483 None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:00:58.215975 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:00:58.221795 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f82010-07bc-459b-9186-e7a2a45b3483 None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:00:58.254006 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791d9810-3c15-42a5-beb5-4d908892cf6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:00:58.254539 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791d9810-3c15-42a5-beb5-4d908892cf6e None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:00:58.254820 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791d9810-3c15-42a5-beb5-4d908892cf6e None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:00:58.255094 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791d9810-3c15-42a5-beb5-4d908892cf6e None admin] PATH_INFO: `/v3/services` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:00:58.256345 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791d9810-3c15-42a5-beb5-4d908892cf6e None admin] RBAC: Adding query filter params (type=placement) {{(pid=81533) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 11:00:58.256653 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791d9810-3c15-42a5-beb5-4d908892cf6e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:00:58.258047 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791d9810-3c15-42a5-beb5-4d908892cf6e None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:00:58.262569 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 487/969] 10.222.0.18 () {56 vars in 1116 bytes} [Thu Oct 13 11:00:58 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 11:01:00.396554 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070cb5c0-8901-4399-905b-de2e61abbef9 None None] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:01:00.397159 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070cb5c0-8901-4399-905b-de2e61abbef9 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:01:00.397159 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070cb5c0-8901-4399-905b-de2e61abbef9 None None] PATH_INFO: `/` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:01:00.398453 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 483/970] 10.222.0.18 () {54 vars in 927 bytes} [Thu Oct 13 11:01:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 11:01:00.403724 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec6f28f-5a22-4751-aef4-fb986e198481 None None] REQUEST_METHOD: `POST` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:01:00.404120 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec6f28f-5a22-4751-aef4-fb986e198481 None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:01:00.404267 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec6f28f-5a22-4751-aef4-fb986e198481 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:01:00.422573 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.auth.core [None req-5ec6f28f-5a22-4751-aef4-fb986e198481 None None] MFA Rules not processed for user `8ba31ade43694cf8bf28f7528a9ea179`. Rule list: `[]` (Enabled: `True`). {{(pid=81533) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 11:01:00.423740 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-5ec6f28f-5a22-4751-aef4-fb986e198481 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:01:00.487813 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 488/971] 10.222.0.18 () {58 vars in 1024 bytes} [Thu Oct 13 11:01:00 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 13 11:01:00.763965 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070cb5c0-8901-4399-905b-de2e61abbef9 None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:01:00.861478 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070cb5c0-8901-4399-905b-de2e61abbef9 None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:01:00.893851 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47d2edc-837b-41d9-901b-1bbafe8d847b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:01:00.894437 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47d2edc-837b-41d9-901b-1bbafe8d847b None admin] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:01:00.894717 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47d2edc-837b-41d9-901b-1bbafe8d847b None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:01:00.894991 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47d2edc-837b-41d9-901b-1bbafe8d847b None admin] PATH_INFO: `/v3/services` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:01:00.895646 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47d2edc-837b-41d9-901b-1bbafe8d847b None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:01:00.897736 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47d2edc-837b-41d9-901b-1bbafe8d847b None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:01:00.911723 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 484/972] 10.222.0.18 () {60 vars in 1141 bytes} [Thu Oct 13 11:01:00 2022] POST /identity/v3/services => generated 246 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 13 11:01:03.062390 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6acfc8f-26f9-4e90-987f-b413bd632916 None None] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:01:03.062911 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6acfc8f-26f9-4e90-987f-b413bd632916 None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:01:03.062911 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6acfc8f-26f9-4e90-987f-b413bd632916 None None] PATH_INFO: `/` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:01:03.064202 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 489/973] 10.222.0.18 () {54 vars in 927 bytes} [Thu Oct 13 11:01:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 11:01:03.069609 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d9191c-b480-4357-8d63-73be59a974aa None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:01:03.070002 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d9191c-b480-4357-8d63-73be59a974aa None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:01:03.070158 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d9191c-b480-4357-8d63-73be59a974aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:01:03.088360 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-e0d9191c-b480-4357-8d63-73be59a974aa None None] MFA Rules not processed for user `8ba31ade43694cf8bf28f7528a9ea179`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 11:01:03.089558 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-e0d9191c-b480-4357-8d63-73be59a974aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:01:03.098352 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:01:03.161985 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 485/974] 10.222.0.18 () {58 vars in 1024 bytes} [Thu Oct 13 11:01:03 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 13 11:01:03.428462 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6acfc8f-26f9-4e90-987f-b413bd632916 None None] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:01:03.531066 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:01:03.541692 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6acfc8f-26f9-4e90-987f-b413bd632916 None None] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:01:03.575041 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf132ce-9feb-42be-8cc7-b079982d0c93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:01:03.575649 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf132ce-9feb-42be-8cc7-b079982d0c93 None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:01:03.575924 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf132ce-9feb-42be-8cc7-b079982d0c93 None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:01:03.576193 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf132ce-9feb-42be-8cc7-b079982d0c93 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:01:03.576763 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf132ce-9feb-42be-8cc7-b079982d0c93 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:01:03.578142 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf132ce-9feb-42be-8cc7-b079982d0c93 None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:01:03.586966 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application [None req-6cf132ce-9feb-42be-8cc7-b079982d0c93 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Oct 13 11:01:03.586966 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 11:01:03.586966 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 13 11:01:03.586966 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 13 11:01:03.586966 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 13 11:01:03.586966 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 13 11:01:03.586966 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 13 11:01:03.586966 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 13 11:01:03.586966 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 13 11:01:03.586966 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application Oct 13 11:01:03.586966 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 13 11:01:03.586966 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application Oct 13 11:01:03.586966 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 11:01:03.586966 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 11:01:03.586966 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 11:01:03.586966 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 11:01:03.586966 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 11:01:03.588240 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 11:01:03.588240 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 11:01:03.588240 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 11:01:03.588240 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 11:01:03.588240 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 11:01:03.588240 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 11:01:03.588240 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 13 11:01:03.588240 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 13 11:01:03.588240 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 13 11:01:03.588240 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 13 11:01:03.588240 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 11:01:03.588240 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 11:01:03.588240 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 11:01:03.588240 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 11:01:03.588240 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 11:01:03.588240 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 11:01:03.589372 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 11:01:03.589372 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application with Lock( Oct 13 11:01:03.589372 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 11:01:03.589372 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._enter() Oct 13 11:01:03.589372 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 11:01:03.589372 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 11:01:03.589372 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 11:01:03.589372 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.creator() Oct 13 11:01:03.589372 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 11:01:03.589372 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application created_value = creator( Oct 13 11:01:03.589372 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 13 11:01:03.589372 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 13 11:01:03.589372 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 13 11:01:03.589372 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application Oct 13 11:01:03.589372 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 490/975] 10.222.0.18 () {56 vars in 1117 bytes} [Thu Oct 13 11:01:03 2022] GET /identity/v3/services/placement => generated 90 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 11:01:03.594127 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d9191c-b480-4357-8d63-73be59a974aa None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:01:03.689028 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d9191c-b480-4357-8d63-73be59a974aa None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:01:03.721636 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925074e8-8081-4e76-9d30-a0933ee4932a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:01:03.722221 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925074e8-8081-4e76-9d30-a0933ee4932a None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:01:03.722496 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925074e8-8081-4e76-9d30-a0933ee4932a None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:01:03.722765 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925074e8-8081-4e76-9d30-a0933ee4932a None admin] PATH_INFO: `/v3/services` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:01:03.723382 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925074e8-8081-4e76-9d30-a0933ee4932a None admin] RBAC: Adding query filter params (name=placement) {{(pid=81534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 11:01:03.723679 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925074e8-8081-4e76-9d30-a0933ee4932a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:01:03.725078 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925074e8-8081-4e76-9d30-a0933ee4932a None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:01:03.730414 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 486/976] 10.222.0.18 () {56 vars in 1116 bytes} [Thu Oct 13 11:01:03 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 11:01:03.735962 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf132ce-9feb-42be-8cc7-b079982d0c93 None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:01:03.834494 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf132ce-9feb-42be-8cc7-b079982d0c93 None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:01:03.866691 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a23f96c-b78c-4d99-ba31-4d25afbf61b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:01:03.867275 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a23f96c-b78c-4d99-ba31-4d25afbf61b8 None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:01:03.867554 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a23f96c-b78c-4d99-ba31-4d25afbf61b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:01:03.867827 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a23f96c-b78c-4d99-ba31-4d25afbf61b8 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:01:03.868520 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a23f96c-b78c-4d99-ba31-4d25afbf61b8 None admin] RBAC: Adding query filter params (interface=public, service_id=442cf5e6d9ca44c1a07cf0fbab65fa77, region_id=RegionOne) {{(pid=81533) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 11:01:03.868829 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a23f96c-b78c-4d99-ba31-4d25afbf61b8 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:01:03.870216 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a23f96c-b78c-4d99-ba31-4d25afbf61b8 None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:01:03.875018 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 491/977] 10.222.0.18 () {56 vars in 1251 bytes} [Thu Oct 13 11:01:03 2022] GET /identity/v3/endpoints?service_id=442cf5e6d9ca44c1a07cf0fbab65fa77&interface=public®ion_id=RegionOne => generated 194 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 11:01:03.880601 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925074e8-8081-4e76-9d30-a0933ee4932a None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:01:03.885169 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:01:03.976511 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925074e8-8081-4e76-9d30-a0933ee4932a None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:01:04.008105 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76cf61ce-c7ff-425a-bd4c-f141d1619aa3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:01:04.008680 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cf61ce-c7ff-425a-bd4c-f141d1619aa3 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:01:04.008952 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cf61ce-c7ff-425a-bd4c-f141d1619aa3 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:01:04.009248 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cf61ce-c7ff-425a-bd4c-f141d1619aa3 None admin] PATH_INFO: `/v3/services` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:01:04.009841 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76cf61ce-c7ff-425a-bd4c-f141d1619aa3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:01:04.011443 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76cf61ce-c7ff-425a-bd4c-f141d1619aa3 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:01:04.017887 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 487/978] 10.222.0.18 () {56 vars in 1087 bytes} [Thu Oct 13 11:01:03 2022] GET /identity/v3/services => generated 2191 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 13 11:01:06.162212 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d348c1-7ff1-4294-84cd-3a907943d293 None None] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:01:06.162741 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d348c1-7ff1-4294-84cd-3a907943d293 None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:01:06.162848 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d348c1-7ff1-4294-84cd-3a907943d293 None None] PATH_INFO: `/` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:01:06.164101 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 492/979] 10.222.0.18 () {54 vars in 927 bytes} [Thu Oct 13 11:01:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 11:01:06.169326 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47eaadc7-9bf3-4890-8a69-edd347190368 None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:01:06.169705 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47eaadc7-9bf3-4890-8a69-edd347190368 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:01:06.169881 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47eaadc7-9bf3-4890-8a69-edd347190368 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:01:06.188041 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-47eaadc7-9bf3-4890-8a69-edd347190368 None None] MFA Rules not processed for user `8ba31ade43694cf8bf28f7528a9ea179`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 11:01:06.189257 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-47eaadc7-9bf3-4890-8a69-edd347190368 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:01:06.249360 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:01:06.255082 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 488/980] 10.222.0.18 () {58 vars in 1024 bytes} [Thu Oct 13 11:01:06 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 13 11:01:06.537233 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d348c1-7ff1-4294-84cd-3a907943d293 None None] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:01:06.556748 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:01:06.637031 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d348c1-7ff1-4294-84cd-3a907943d293 None None] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:01:06.669834 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af6121e-cd59-4c54-9269-d9fe3bb292d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:01:06.670446 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af6121e-cd59-4c54-9269-d9fe3bb292d7 None admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:01:06.670726 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af6121e-cd59-4c54-9269-d9fe3bb292d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:01:06.670998 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af6121e-cd59-4c54-9269-d9fe3bb292d7 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:01:06.671575 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af6121e-cd59-4c54-9269-d9fe3bb292d7 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:01:06.672935 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af6121e-cd59-4c54-9269-d9fe3bb292d7 None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:01:06.682127 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application [None req-5af6121e-cd59-4c54-9269-d9fe3bb292d7 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Oct 13 11:01:06.682127 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 11:01:06.682127 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 13 11:01:06.682127 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 13 11:01:06.682127 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 13 11:01:06.682127 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 13 11:01:06.682127 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 13 11:01:06.682127 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 13 11:01:06.682127 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 13 11:01:06.682127 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application Oct 13 11:01:06.682127 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 13 11:01:06.682127 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application Oct 13 11:01:06.682127 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 13 11:01:06.682127 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 13 11:01:06.682127 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 13 11:01:06.682127 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 13 11:01:06.682127 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 13 11:01:06.683262 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 13 11:01:06.683262 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 13 11:01:06.683262 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 13 11:01:06.683262 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 13 11:01:06.683262 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 13 11:01:06.683262 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 13 11:01:06.683262 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 13 11:01:06.683262 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 13 11:01:06.683262 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 13 11:01:06.683262 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 13 11:01:06.683262 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 13 11:01:06.683262 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 13 11:01:06.683262 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 13 11:01:06.683262 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 13 11:01:06.683262 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 13 11:01:06.683262 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.get_or_create( Oct 13 11:01:06.684248 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 13 11:01:06.684248 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application with Lock( Oct 13 11:01:06.684248 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 13 11:01:06.684248 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self._enter() Oct 13 11:01:06.684248 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 13 11:01:06.684248 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 13 11:01:06.684248 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 13 11:01:06.684248 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application return self.creator() Oct 13 11:01:06.684248 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 13 11:01:06.684248 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application created_value = creator( Oct 13 11:01:06.684248 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 13 11:01:06.684248 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 13 11:01:06.684248 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 13 11:01:06.684248 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: ERROR keystone.server.flask.application Oct 13 11:01:06.684248 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 493/981] 10.222.0.18 () {56 vars in 1117 bytes} [Thu Oct 13 11:01:06 2022] GET /identity/v3/services/placement => generated 90 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 13 11:01:06.689166 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47eaadc7-9bf3-4890-8a69-edd347190368 None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:01:06.785908 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47eaadc7-9bf3-4890-8a69-edd347190368 None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:01:06.819088 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501913d3-82d4-4d28-a8bf-c62d6ffd6f9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:01:06.819618 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501913d3-82d4-4d28-a8bf-c62d6ffd6f9e None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:01:06.819896 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501913d3-82d4-4d28-a8bf-c62d6ffd6f9e None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:01:06.820168 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501913d3-82d4-4d28-a8bf-c62d6ffd6f9e None admin] PATH_INFO: `/v3/services` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:01:06.820794 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501913d3-82d4-4d28-a8bf-c62d6ffd6f9e None admin] RBAC: Adding query filter params (name=placement) {{(pid=81534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 11:01:06.821126 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501913d3-82d4-4d28-a8bf-c62d6ffd6f9e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:01:06.822478 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501913d3-82d4-4d28-a8bf-c62d6ffd6f9e None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:01:06.827447 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 489/982] 10.222.0.18 () {56 vars in 1116 bytes} [Thu Oct 13 11:01:06 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 11:01:06.833223 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af6121e-cd59-4c54-9269-d9fe3bb292d7 None admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:01:06.912953 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:01:06.930791 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af6121e-cd59-4c54-9269-d9fe3bb292d7 None admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:01:06.962761 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ae2ddf-7844-41f0-b3b5-abcc65a92417 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:01:06.963346 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ae2ddf-7844-41f0-b3b5-abcc65a92417 None admin] REQUEST_METHOD: `POST` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:01:06.963622 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ae2ddf-7844-41f0-b3b5-abcc65a92417 None admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:01:06.963888 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ae2ddf-7844-41f0-b3b5-abcc65a92417 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:01:06.964537 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ae2ddf-7844-41f0-b3b5-abcc65a92417 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:01:06.965991 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ae2ddf-7844-41f0-b3b5-abcc65a92417 None admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:01:06.986195 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 494/983] 10.222.0.18 () {60 vars in 1144 bytes} [Thu Oct 13 11:01:06 2022] POST /identity/v3/endpoints => generated 331 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 13 11:01:16.824708 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=69 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:01:16.982437 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=30,keystone:INSERT=1 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:02:10.870682 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d67e61-5bdf-46cc-838f-e50ab4187816 None None] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:02:10.871145 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d67e61-5bdf-46cc-838f-e50ab4187816 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:02:10.871231 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d67e61-5bdf-46cc-838f-e50ab4187816 None None] PATH_INFO: `/` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:02:10.876386 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 490/984] 10.222.0.18 () {54 vars in 927 bytes} [Thu Oct 13 11:02:10 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 11:02:10.878334 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31efcfd2-cb6e-411b-bb9e-4e11de2fb26d None None] REQUEST_METHOD: `POST` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:02:10.879355 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31efcfd2-cb6e-411b-bb9e-4e11de2fb26d None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:02:10.879926 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31efcfd2-cb6e-411b-bb9e-4e11de2fb26d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:02:11.009953 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.auth.core [None req-31efcfd2-cb6e-411b-bb9e-4e11de2fb26d None None] MFA Rules not processed for user `8ba31ade43694cf8bf28f7528a9ea179`. Rule list: `[]` (Enabled: `True`). {{(pid=81533) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 11:02:11.011563 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-31efcfd2-cb6e-411b-bb9e-4e11de2fb26d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:02:11.127744 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 495/985] 10.222.0.18 () {58 vars in 1024 bytes} [Thu Oct 13 11:02:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 251 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 11:02:11.425421 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee05ac9-3cba-49f0-944b-0e0aa038d4f4 None None] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:02:11.425952 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee05ac9-3cba-49f0-944b-0e0aa038d4f4 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:02:11.426230 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee05ac9-3cba-49f0-944b-0e0aa038d4f4 None None] PATH_INFO: `/` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:02:11.427591 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 491/986] 10.222.0.18 () {54 vars in 964 bytes} [Thu Oct 13 11:02:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 11:02:11.434734 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3d1048-731a-4fda-82ae-088692400cf8 None None] REQUEST_METHOD: `POST` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:02:11.435101 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3d1048-731a-4fda-82ae-088692400cf8 None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:02:11.435443 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3d1048-731a-4fda-82ae-088692400cf8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:02:11.524689 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.auth.core [None req-ff3d1048-731a-4fda-82ae-088692400cf8 None None] MFA Rules not processed for user `6d31effc2bc44d698b5adb5254263dc5`. Rule list: `[]` (Enabled: `True`). {{(pid=81533) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 11:02:11.525960 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-ff3d1048-731a-4fda-82ae-088692400cf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:02:11.548643 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:02:11.610378 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 496/987] 10.222.0.18 () {58 vars in 1061 bytes} [Thu Oct 13 11:02:11 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 11:02:11.619960 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee05ac9-3cba-49f0-944b-0e0aa038d4f4 None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:02:11.621876 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-0ee05ac9-3cba-49f0-944b-0e0aa038d4f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:02:11.741819 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee05ac9-3cba-49f0-944b-0e0aa038d4f4 None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:02:11.827373 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56dfebaa-2ffd-4367-8e11-2cb9bca03aac service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d31effc2bc44d698b5adb5254263dc5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '112613528384453abe7506465609fbd8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:02:11.828001 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56dfebaa-2ffd-4367-8e11-2cb9bca03aac service neutron] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:02:11.828355 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56dfebaa-2ffd-4367-8e11-2cb9bca03aac service neutron] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:02:11.828692 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56dfebaa-2ffd-4367-8e11-2cb9bca03aac service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:02:11.830391 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-56dfebaa-2ffd-4367-8e11-2cb9bca03aac service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:02:11.889812 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:02:11.950084 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56dfebaa-2ffd-4367-8e11-2cb9bca03aac service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:02:11.951614 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56dfebaa-2ffd-4367-8e11-2cb9bca03aac service neutron] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:02:11.971515 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 492/988] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Oct 13 11:02:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 13 11:02:14.459179 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f1fd58-0b5e-4a34-a34a-f6c8174edff3 None None] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:02:14.459757 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f1fd58-0b5e-4a34-a34a-f6c8174edff3 None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:02:14.459757 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f1fd58-0b5e-4a34-a34a-f6c8174edff3 None None] PATH_INFO: `/` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:02:14.461034 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 497/989] 10.222.0.18 () {54 vars in 927 bytes} [Thu Oct 13 11:02:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 11:02:14.466218 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa9fd2f-5772-4691-b61e-98b7f9373967 None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:02:14.466625 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa9fd2f-5772-4691-b61e-98b7f9373967 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:02:14.466801 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa9fd2f-5772-4691-b61e-98b7f9373967 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:02:14.550481 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-1aa9fd2f-5772-4691-b61e-98b7f9373967 None None] MFA Rules not processed for user `8ba31ade43694cf8bf28f7528a9ea179`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 11:02:14.551694 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-1aa9fd2f-5772-4691-b61e-98b7f9373967 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:02:14.649883 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 493/990] 10.222.0.18 () {58 vars in 1024 bytes} [Thu Oct 13 11:02:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 11:02:14.934650 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f1fd58-0b5e-4a34-a34a-f6c8174edff3 None None] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:02:14.936195 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-f1f1fd58-0b5e-4a34-a34a-f6c8174edff3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:02:15.049665 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f1fd58-0b5e-4a34-a34a-f6c8174edff3 None None] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:02:15.124376 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:02:15.127010 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0170378-ed51-4c9f-9c96-fe2c4e9be748 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d31effc2bc44d698b5adb5254263dc5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '112613528384453abe7506465609fbd8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:02:15.127865 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0170378-ed51-4c9f-9c96-fe2c4e9be748 service neutron] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:02:15.128301 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0170378-ed51-4c9f-9c96-fe2c4e9be748 service neutron] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:02:15.128615 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0170378-ed51-4c9f-9c96-fe2c4e9be748 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:02:15.130472 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-f0170378-ed51-4c9f-9c96-fe2c4e9be748 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:02:15.238582 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0170378-ed51-4c9f-9c96-fe2c4e9be748 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:02:15.240021 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0170378-ed51-4c9f-9c96-fe2c4e9be748 service neutron] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:02:15.258841 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 498/991] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Oct 13 11:02:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 13 11:02:17.725934 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c696b741-8e7b-48d4-842f-a98e3f107636 None None] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:02:17.726570 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c696b741-8e7b-48d4-842f-a98e3f107636 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:02:17.726570 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c696b741-8e7b-48d4-842f-a98e3f107636 None None] PATH_INFO: `/` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:02:17.727834 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 494/992] 10.222.0.18 () {54 vars in 927 bytes} [Thu Oct 13 11:02:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 11:02:17.734281 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b27a8d-1e80-4939-8c8c-4143c96b50ea None None] REQUEST_METHOD: `POST` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:02:17.734712 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b27a8d-1e80-4939-8c8c-4143c96b50ea None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:02:17.734831 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b27a8d-1e80-4939-8c8c-4143c96b50ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:02:17.799617 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.auth.core [None req-f2b27a8d-1e80-4939-8c8c-4143c96b50ea None None] MFA Rules not processed for user `e6970c8c44f247bf84dac44daa2e7f44`. Rule list: `[]` (Enabled: `True`). {{(pid=81533) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 11:02:17.800805 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-f2b27a8d-1e80-4939-8c8c-4143c96b50ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:02:17.852874 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:02:17.897538 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 499/993] 10.222.0.18 () {58 vars in 1024 bytes} [Thu Oct 13 11:02:17 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 11:02:18.182726 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c696b741-8e7b-48d4-842f-a98e3f107636 None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:02:18.184265 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-c696b741-8e7b-48d4-842f-a98e3f107636 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:02:18.195584 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:02:18.288977 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c696b741-8e7b-48d4-842f-a98e3f107636 None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:02:18.359453 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4f701d-89f1-4503-9588-d2e7e90f4ba1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d31effc2bc44d698b5adb5254263dc5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '112613528384453abe7506465609fbd8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:02:18.360050 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4f701d-89f1-4503-9588-d2e7e90f4ba1 service neutron] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:02:18.360328 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4f701d-89f1-4503-9588-d2e7e90f4ba1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:02:18.360601 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4f701d-89f1-4503-9588-d2e7e90f4ba1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:02:18.362215 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-8c4f701d-89f1-4503-9588-d2e7e90f4ba1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:02:18.423968 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:02:18.470390 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4f701d-89f1-4503-9588-d2e7e90f4ba1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:02:18.471750 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4f701d-89f1-4503-9588-d2e7e90f4ba1 service neutron] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:02:18.490392 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 495/994] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Oct 13 11:02:18 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 13 11:02:21.133411 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a4783f-d6ac-4849-805e-307617966514 None None] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:02:21.133921 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a4783f-d6ac-4849-805e-307617966514 None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:02:21.133921 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a4783f-d6ac-4849-805e-307617966514 None None] PATH_INFO: `/` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:02:21.135231 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 500/995] 10.222.0.18 () {54 vars in 927 bytes} [Thu Oct 13 11:02:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 11:02:21.140823 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb2e67f-26b8-4cc3-8194-5912169a7b4e None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:02:21.141278 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb2e67f-26b8-4cc3-8194-5912169a7b4e None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:02:21.141403 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb2e67f-26b8-4cc3-8194-5912169a7b4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:02:21.206011 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-8bb2e67f-26b8-4cc3-8194-5912169a7b4e None None] MFA Rules not processed for user `8ba31ade43694cf8bf28f7528a9ea179`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 11:02:21.207204 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-8bb2e67f-26b8-4cc3-8194-5912169a7b4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:02:21.300377 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 496/996] 10.222.0.18 () {58 vars in 1024 bytes} [Thu Oct 13 11:02:21 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 11:02:21.593416 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a4783f-d6ac-4849-805e-307617966514 None None] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:02:21.595004 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-30a4783f-d6ac-4849-805e-307617966514 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:02:21.698916 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a4783f-d6ac-4849-805e-307617966514 None None] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:02:21.771400 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dafa96d4-7357-43b9-9907-6c6e141c9367 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d31effc2bc44d698b5adb5254263dc5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '112613528384453abe7506465609fbd8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:02:21.772198 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafa96d4-7357-43b9-9907-6c6e141c9367 service neutron] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:02:21.772678 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafa96d4-7357-43b9-9907-6c6e141c9367 service neutron] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:02:21.772956 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafa96d4-7357-43b9-9907-6c6e141c9367 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:02:21.774580 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-dafa96d4-7357-43b9-9907-6c6e141c9367 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:02:21.782211 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:02:21.882564 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dafa96d4-7357-43b9-9907-6c6e141c9367 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:02:21.883909 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dafa96d4-7357-43b9-9907-6c6e141c9367 service neutron] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:02:21.902145 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 501/997] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Oct 13 11:02:21 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 13 11:02:24.688543 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b6e263-bbf9-4878-9b49-7e1254f7eb11 None None] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:02:24.689194 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b6e263-bbf9-4878-9b49-7e1254f7eb11 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:02:24.689194 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b6e263-bbf9-4878-9b49-7e1254f7eb11 None None] PATH_INFO: `/` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:02:24.690555 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 497/998] 10.222.0.18 () {54 vars in 927 bytes} [Thu Oct 13 11:02:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 11:02:24.696744 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed887bc5-c0f1-4833-bdc8-c19ca0157f49 None None] REQUEST_METHOD: `POST` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:02:24.697173 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed887bc5-c0f1-4833-bdc8-c19ca0157f49 None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:02:24.697364 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed887bc5-c0f1-4833-bdc8-c19ca0157f49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:02:24.768645 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.auth.core [None req-ed887bc5-c0f1-4833-bdc8-c19ca0157f49 None None] MFA Rules not processed for user `8ba31ade43694cf8bf28f7528a9ea179`. Rule list: `[]` (Enabled: `True`). {{(pid=81533) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 11:02:24.769907 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-ed887bc5-c0f1-4833-bdc8-c19ca0157f49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:02:24.832419 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:02:24.874486 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 502/999] 10.222.0.18 () {58 vars in 1024 bytes} [Thu Oct 13 11:02:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 11:02:25.164833 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b6e263-bbf9-4878-9b49-7e1254f7eb11 None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:02:25.166393 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-c0b6e263-bbf9-4878-9b49-7e1254f7eb11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:02:25.186736 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:02:25.272068 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b6e263-bbf9-4878-9b49-7e1254f7eb11 None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:02:25.344464 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e9fc31-3a13-44a0-b8be-8a6a794e1303 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d31effc2bc44d698b5adb5254263dc5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '112613528384453abe7506465609fbd8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:02:25.345092 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e9fc31-3a13-44a0-b8be-8a6a794e1303 service neutron] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:02:25.345369 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e9fc31-3a13-44a0-b8be-8a6a794e1303 service neutron] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:02:25.345637 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e9fc31-3a13-44a0-b8be-8a6a794e1303 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:02:25.347204 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-51e9fc31-3a13-44a0-b8be-8a6a794e1303 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:02:25.417840 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:02:25.455853 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e9fc31-3a13-44a0-b8be-8a6a794e1303 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:02:25.457324 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e9fc31-3a13-44a0-b8be-8a6a794e1303 service neutron] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:02:25.476241 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 498/1000] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Oct 13 11:02:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 13 11:02:27.714401 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec6dfd6-3be2-4fea-aadb-63722d3e30da None None] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:02:27.714936 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec6dfd6-3be2-4fea-aadb-63722d3e30da None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:02:27.714936 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec6dfd6-3be2-4fea-aadb-63722d3e30da None None] PATH_INFO: `/` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:02:27.716307 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 503/1001] 10.222.0.18 () {54 vars in 927 bytes} [Thu Oct 13 11:02:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 11:02:27.721812 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceac2b70-0f51-47f5-a528-24261f526f0d None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:02:27.722222 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceac2b70-0f51-47f5-a528-24261f526f0d None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:02:27.722358 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceac2b70-0f51-47f5-a528-24261f526f0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:02:27.789517 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-ceac2b70-0f51-47f5-a528-24261f526f0d None None] MFA Rules not processed for user `8ba31ade43694cf8bf28f7528a9ea179`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 11:02:27.790728 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-ceac2b70-0f51-47f5-a528-24261f526f0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:02:27.892650 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 499/1002] 10.222.0.18 () {58 vars in 1024 bytes} [Thu Oct 13 11:02:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 11:02:28.177903 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec6dfd6-3be2-4fea-aadb-63722d3e30da None None] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:02:28.180210 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-6ec6dfd6-3be2-4fea-aadb-63722d3e30da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:02:28.283307 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec6dfd6-3be2-4fea-aadb-63722d3e30da None None] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:02:28.358629 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89da0e7e-fdb8-40f5-80c9-08c33773399f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d31effc2bc44d698b5adb5254263dc5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '112613528384453abe7506465609fbd8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:02:28.359231 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89da0e7e-fdb8-40f5-80c9-08c33773399f service neutron] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:02:28.359509 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89da0e7e-fdb8-40f5-80c9-08c33773399f service neutron] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:02:28.359787 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89da0e7e-fdb8-40f5-80c9-08c33773399f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:02:28.361394 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-89da0e7e-fdb8-40f5-80c9-08c33773399f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:02:28.378147 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:02:28.470752 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89da0e7e-fdb8-40f5-80c9-08c33773399f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:02:28.472153 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89da0e7e-fdb8-40f5-80c9-08c33773399f service neutron] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:02:28.490045 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 504/1003] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Oct 13 11:02:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 13 11:02:30.731474 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7171847c-dd4e-4927-9236-43b440737339 None None] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:02:30.731851 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7171847c-dd4e-4927-9236-43b440737339 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:02:30.731851 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7171847c-dd4e-4927-9236-43b440737339 None None] PATH_INFO: `/` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:02:30.733370 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 500/1004] 10.222.0.18 () {54 vars in 927 bytes} [Thu Oct 13 11:02:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 11:02:30.738589 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd25c7bc-bef6-4f17-aab6-6c897bfabb5d None None] REQUEST_METHOD: `POST` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:02:30.739048 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd25c7bc-bef6-4f17-aab6-6c897bfabb5d None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:02:30.739148 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd25c7bc-bef6-4f17-aab6-6c897bfabb5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:02:30.807307 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.auth.core [None req-dd25c7bc-bef6-4f17-aab6-6c897bfabb5d None None] MFA Rules not processed for user `e6970c8c44f247bf84dac44daa2e7f44`. Rule list: `[]` (Enabled: `True`). {{(pid=81533) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 11:02:30.808498 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-dd25c7bc-bef6-4f17-aab6-6c897bfabb5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:02:30.874695 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:02:30.907078 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 505/1005] 10.222.0.18 () {58 vars in 1024 bytes} [Thu Oct 13 11:02:30 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 11:02:31.199842 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7171847c-dd4e-4927-9236-43b440737339 None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:02:31.201464 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-7171847c-dd4e-4927-9236-43b440737339 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:02:31.234808 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:02:31.308447 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7171847c-dd4e-4927-9236-43b440737339 None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:02:31.383205 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a339aebd-b8c9-4ba6-847a-ed40df37ae1f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d31effc2bc44d698b5adb5254263dc5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '112613528384453abe7506465609fbd8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:02:31.383924 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a339aebd-b8c9-4ba6-847a-ed40df37ae1f service neutron] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:02:31.384210 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a339aebd-b8c9-4ba6-847a-ed40df37ae1f service neutron] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:02:31.384483 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a339aebd-b8c9-4ba6-847a-ed40df37ae1f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:02:31.386109 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-a339aebd-b8c9-4ba6-847a-ed40df37ae1f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:02:31.463354 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:02:31.496153 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a339aebd-b8c9-4ba6-847a-ed40df37ae1f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:02:31.497571 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a339aebd-b8c9-4ba6-847a-ed40df37ae1f service neutron] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:02:31.515829 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 501/1006] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Oct 13 11:02:31 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 13 11:02:33.896598 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee90888-1473-4da9-8d39-100bfffb594a None None] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:02:33.897722 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee90888-1473-4da9-8d39-100bfffb594a None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:02:33.897825 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee90888-1473-4da9-8d39-100bfffb594a None None] PATH_INFO: `/` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:02:33.899268 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 506/1007] 10.222.0.18 () {54 vars in 927 bytes} [Thu Oct 13 11:02:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 11:02:33.904599 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f50418-1ea0-4d8b-840d-d97cd7d51af7 None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:02:33.905031 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f50418-1ea0-4d8b-840d-d97cd7d51af7 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:02:33.905173 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f50418-1ea0-4d8b-840d-d97cd7d51af7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:02:33.970473 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-21f50418-1ea0-4d8b-840d-d97cd7d51af7 None None] MFA Rules not processed for user `8ba31ade43694cf8bf28f7528a9ea179`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 11:02:33.971683 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-21f50418-1ea0-4d8b-840d-d97cd7d51af7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:02:34.065412 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 502/1008] 10.222.0.18 () {58 vars in 1024 bytes} [Thu Oct 13 11:02:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 13 11:02:34.353020 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee90888-1473-4da9-8d39-100bfffb594a None None] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:02:34.354636 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-1ee90888-1473-4da9-8d39-100bfffb594a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:02:34.456652 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee90888-1473-4da9-8d39-100bfffb594a None None] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:02:34.530464 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3002a03-d9e9-42fb-ab17-35b7a1e49717 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d31effc2bc44d698b5adb5254263dc5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '112613528384453abe7506465609fbd8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:02:34.531054 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3002a03-d9e9-42fb-ab17-35b7a1e49717 service neutron] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:02:34.531328 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3002a03-d9e9-42fb-ab17-35b7a1e49717 service neutron] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:02:34.531597 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3002a03-d9e9-42fb-ab17-35b7a1e49717 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:02:34.533210 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-c3002a03-d9e9-42fb-ab17-35b7a1e49717 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:02:34.559696 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:02:34.639029 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3002a03-d9e9-42fb-ab17-35b7a1e49717 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:02:34.640654 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3002a03-d9e9-42fb-ab17-35b7a1e49717 service neutron] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:02:34.658845 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 507/1009] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Oct 13 11:02:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 13 11:02:36.859631 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c397575e-be3c-4a45-9ec9-db993ff8bba5 None None] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:02:36.860180 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c397575e-be3c-4a45-9ec9-db993ff8bba5 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:02:36.860180 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c397575e-be3c-4a45-9ec9-db993ff8bba5 None None] PATH_INFO: `/` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:02:36.861556 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 503/1010] 10.222.0.18 () {54 vars in 927 bytes} [Thu Oct 13 11:02:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 11:02:36.867449 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa82785-1bec-49be-a5f0-5454a958b53b None None] REQUEST_METHOD: `POST` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:02:36.867914 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa82785-1bec-49be-a5f0-5454a958b53b None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:02:36.868009 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa82785-1bec-49be-a5f0-5454a958b53b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:02:36.934499 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.auth.core [None req-6aa82785-1bec-49be-a5f0-5454a958b53b None None] MFA Rules not processed for user `8ba31ade43694cf8bf28f7528a9ea179`. Rule list: `[]` (Enabled: `True`). {{(pid=81533) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 11:02:36.935704 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-6aa82785-1bec-49be-a5f0-5454a958b53b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:02:37.016772 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:02:37.038985 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 508/1011] 10.222.0.18 () {58 vars in 1024 bytes} [Thu Oct 13 11:02:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 11:02:37.326852 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c397575e-be3c-4a45-9ec9-db993ff8bba5 None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:02:37.328698 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-c397575e-be3c-4a45-9ec9-db993ff8bba5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:02:37.368591 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:02:37.432155 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c397575e-be3c-4a45-9ec9-db993ff8bba5 None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:02:37.505176 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84727138-bfe5-453b-ae33-4b0eb02c002e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d31effc2bc44d698b5adb5254263dc5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '112613528384453abe7506465609fbd8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:02:37.505771 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84727138-bfe5-453b-ae33-4b0eb02c002e service neutron] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:02:37.506047 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84727138-bfe5-453b-ae33-4b0eb02c002e service neutron] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:02:37.506355 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84727138-bfe5-453b-ae33-4b0eb02c002e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:02:37.508029 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-84727138-bfe5-453b-ae33-4b0eb02c002e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:02:37.595897 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:02:37.622603 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84727138-bfe5-453b-ae33-4b0eb02c002e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:02:37.624032 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84727138-bfe5-453b-ae33-4b0eb02c002e service neutron] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:02:37.643193 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 504/1012] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Oct 13 11:02:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 13 11:02:40.122921 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5948667-61c9-4788-b485-6e0e9041fc4f None None] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:02:40.123428 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5948667-61c9-4788-b485-6e0e9041fc4f None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:02:40.123428 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5948667-61c9-4788-b485-6e0e9041fc4f None None] PATH_INFO: `/` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:02:40.124738 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 509/1013] 10.222.0.18 () {54 vars in 927 bytes} [Thu Oct 13 11:02:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 11:02:40.129916 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71a95f7-6ca2-4dcf-beda-ec63e474e467 None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:02:40.130307 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71a95f7-6ca2-4dcf-beda-ec63e474e467 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:02:40.130466 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71a95f7-6ca2-4dcf-beda-ec63e474e467 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:02:40.196807 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-c71a95f7-6ca2-4dcf-beda-ec63e474e467 None None] MFA Rules not processed for user `8ba31ade43694cf8bf28f7528a9ea179`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 11:02:40.198018 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-c71a95f7-6ca2-4dcf-beda-ec63e474e467 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:02:40.293411 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 505/1014] 10.222.0.18 () {58 vars in 1024 bytes} [Thu Oct 13 11:02:40 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 11:02:40.587730 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5948667-61c9-4788-b485-6e0e9041fc4f None None] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:02:40.589291 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-a5948667-61c9-4788-b485-6e0e9041fc4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:02:40.689865 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5948667-61c9-4788-b485-6e0e9041fc4f None None] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:02:40.763385 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f03a5c4-bd17-47b6-a105-41910670d824 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d31effc2bc44d698b5adb5254263dc5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '112613528384453abe7506465609fbd8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:02:40.763985 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f03a5c4-bd17-47b6-a105-41910670d824 service neutron] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:02:40.764264 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f03a5c4-bd17-47b6-a105-41910670d824 service neutron] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:02:40.764535 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f03a5c4-bd17-47b6-a105-41910670d824 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:02:40.766410 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-5f03a5c4-bd17-47b6-a105-41910670d824 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:02:40.802039 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:02:40.874430 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f03a5c4-bd17-47b6-a105-41910670d824 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:02:40.875792 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f03a5c4-bd17-47b6-a105-41910670d824 service neutron] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:02:40.893701 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 510/1015] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Oct 13 11:02:40 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 13 11:02:44.962659 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18267697-9cbf-47c7-a7a9-0c033ed063a3 None None] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:02:44.963166 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18267697-9cbf-47c7-a7a9-0c033ed063a3 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:02:44.963166 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18267697-9cbf-47c7-a7a9-0c033ed063a3 None None] PATH_INFO: `/` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:02:44.964466 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 506/1016] 10.222.0.18 () {54 vars in 927 bytes} [Thu Oct 13 11:02:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 11:02:44.969687 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822a5e95-3d53-4510-8a95-25aa6359fc82 None None] REQUEST_METHOD: `POST` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:02:44.970125 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822a5e95-3d53-4510-8a95-25aa6359fc82 None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:02:44.970235 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822a5e95-3d53-4510-8a95-25aa6359fc82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:02:45.037550 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.auth.core [None req-822a5e95-3d53-4510-8a95-25aa6359fc82 None None] MFA Rules not processed for user `8ba31ade43694cf8bf28f7528a9ea179`. Rule list: `[]` (Enabled: `True`). {{(pid=81533) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 11:02:45.038858 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-822a5e95-3d53-4510-8a95-25aa6359fc82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:02:45.123011 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:02:45.134535 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 511/1017] 10.222.0.18 () {58 vars in 1024 bytes} [Thu Oct 13 11:02:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 11:02:45.435042 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a261fdf3-556e-40c5-9422-142fcdc2e795 None None] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:02:45.435326 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a261fdf3-556e-40c5-9422-142fcdc2e795 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:02:45.435600 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a261fdf3-556e-40c5-9422-142fcdc2e795 None None] PATH_INFO: `/` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:02:45.436940 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 507/1018] 10.222.0.18 () {54 vars in 964 bytes} [Thu Oct 13 11:02:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 11:02:45.442945 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a2901d-f846-4843-9631-f407b6c7ad8e None None] REQUEST_METHOD: `POST` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:02:45.443227 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a2901d-f846-4843-9631-f407b6c7ad8e None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:02:45.443499 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a2901d-f846-4843-9631-f407b6c7ad8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:02:45.520583 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.auth.core [None req-d5a2901d-f846-4843-9631-f407b6c7ad8e None None] MFA Rules not processed for user `6d31effc2bc44d698b5adb5254263dc5`. Rule list: `[]` (Enabled: `True`). {{(pid=81533) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 11:02:45.521823 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-d5a2901d-f846-4843-9631-f407b6c7ad8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:02:45.597328 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 512/1019] 10.222.0.18 () {58 vars in 1061 bytes} [Thu Oct 13 11:02:45 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 11:02:45.607007 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a261fdf3-556e-40c5-9422-142fcdc2e795 None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:02:45.608540 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-a261fdf3-556e-40c5-9422-142fcdc2e795 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:02:45.657215 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:02:45.714568 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a261fdf3-556e-40c5-9422-142fcdc2e795 None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:02:45.791146 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d078b640-a604-4307-a26a-b606ccc3f203 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d31effc2bc44d698b5adb5254263dc5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '112613528384453abe7506465609fbd8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:02:45.791759 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d078b640-a604-4307-a26a-b606ccc3f203 service neutron] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:02:45.792031 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d078b640-a604-4307-a26a-b606ccc3f203 service neutron] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:02:45.792296 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d078b640-a604-4307-a26a-b606ccc3f203 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:02:45.793982 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-d078b640-a604-4307-a26a-b606ccc3f203 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:02:45.901179 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:02:45.923432 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d078b640-a604-4307-a26a-b606ccc3f203 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:02:45.924890 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d078b640-a604-4307-a26a-b606ccc3f203 service neutron] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:02:45.950496 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 508/1020] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Oct 13 11:02:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 13 11:02:49.360198 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee1bb7d-b19b-47e7-8614-56e22ffe9bcf None None] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:02:49.360712 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee1bb7d-b19b-47e7-8614-56e22ffe9bcf None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:02:49.360808 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee1bb7d-b19b-47e7-8614-56e22ffe9bcf None None] PATH_INFO: `/` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:02:49.362112 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 513/1021] 10.222.0.18 () {54 vars in 927 bytes} [Thu Oct 13 11:02:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 11:02:49.367545 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba5ba54-a18e-4059-9685-8033b3c7a534 None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:02:49.367978 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba5ba54-a18e-4059-9685-8033b3c7a534 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:02:49.368225 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba5ba54-a18e-4059-9685-8033b3c7a534 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:02:49.434623 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-1ba5ba54-a18e-4059-9685-8033b3c7a534 None None] MFA Rules not processed for user `8ba31ade43694cf8bf28f7528a9ea179`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 11:02:49.435832 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-1ba5ba54-a18e-4059-9685-8033b3c7a534 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:02:49.556282 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 509/1022] 10.222.0.18 () {58 vars in 1024 bytes} [Thu Oct 13 11:02:49 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 11:02:49.841364 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee1bb7d-b19b-47e7-8614-56e22ffe9bcf None None] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:02:49.842951 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-8ee1bb7d-b19b-47e7-8614-56e22ffe9bcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:02:49.932383 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:02:49.949856 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee1bb7d-b19b-47e7-8614-56e22ffe9bcf None None] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:02:50.023233 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72977c4-9b41-4950-8042-15b72a1eadd6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d31effc2bc44d698b5adb5254263dc5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '112613528384453abe7506465609fbd8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:02:50.023835 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72977c4-9b41-4950-8042-15b72a1eadd6 service neutron] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:02:50.024105 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72977c4-9b41-4950-8042-15b72a1eadd6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:02:50.024371 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72977c4-9b41-4950-8042-15b72a1eadd6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:02:50.025987 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-c72977c4-9b41-4950-8042-15b72a1eadd6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:02:50.133498 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72977c4-9b41-4950-8042-15b72a1eadd6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:02:50.134850 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72977c4-9b41-4950-8042-15b72a1eadd6 service neutron] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:02:50.152332 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 514/1023] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Oct 13 11:02:49 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 13 11:02:54.460598 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41ec613-7217-4c1b-a8da-06892daf30a3 None None] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:02:54.461158 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41ec613-7217-4c1b-a8da-06892daf30a3 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:02:54.461158 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41ec613-7217-4c1b-a8da-06892daf30a3 None None] PATH_INFO: `/` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:02:54.462501 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 510/1024] 10.222.0.18 () {54 vars in 927 bytes} [Thu Oct 13 11:02:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 11:02:54.467904 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8c119e-7ba9-4950-9902-789fa897d6be None None] REQUEST_METHOD: `POST` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:02:54.468374 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8c119e-7ba9-4950-9902-789fa897d6be None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:02:54.468464 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8c119e-7ba9-4950-9902-789fa897d6be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:02:54.487314 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:02:54.545893 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.auth.core [None req-fa8c119e-7ba9-4950-9902-789fa897d6be None None] MFA Rules not processed for user `8ba31ade43694cf8bf28f7528a9ea179`. Rule list: `[]` (Enabled: `True`). {{(pid=81533) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 11:02:54.547139 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-fa8c119e-7ba9-4950-9902-789fa897d6be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:02:54.648908 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 515/1025] 10.222.0.18 () {58 vars in 1024 bytes} [Thu Oct 13 11:02:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 11:02:54.964182 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41ec613-7217-4c1b-a8da-06892daf30a3 None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:02:54.965752 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-a41ec613-7217-4c1b-a8da-06892daf30a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:02:55.021985 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:02:55.067728 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41ec613-7217-4c1b-a8da-06892daf30a3 None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:02:55.140133 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e16599e-ca25-4473-a71d-5228fe35ae69 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d31effc2bc44d698b5adb5254263dc5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '112613528384453abe7506465609fbd8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:02:55.140729 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e16599e-ca25-4473-a71d-5228fe35ae69 service neutron] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:02:55.141288 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e16599e-ca25-4473-a71d-5228fe35ae69 service neutron] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:02:55.141560 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e16599e-ca25-4473-a71d-5228fe35ae69 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:02:55.143147 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-4e16599e-ca25-4473-a71d-5228fe35ae69 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:02:55.246790 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:02:55.250078 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e16599e-ca25-4473-a71d-5228fe35ae69 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:02:55.252167 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e16599e-ca25-4473-a71d-5228fe35ae69 service neutron] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:02:55.270587 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 511/1026] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Oct 13 11:02:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 13 11:03:00.146648 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bb124b-b81a-41d6-a2ac-6b773a1d75b0 None None] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:03:00.147094 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bb124b-b81a-41d6-a2ac-6b773a1d75b0 None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:03:00.147186 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bb124b-b81a-41d6-a2ac-6b773a1d75b0 None None] PATH_INFO: `/` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:03:00.150304 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 516/1027] 10.222.0.18 () {54 vars in 921 bytes} [Thu Oct 13 11:03:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 11:03:00.156017 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc4703b-2e28-475a-a61a-87f5c64c4779 None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:03:00.156469 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc4703b-2e28-475a-a61a-87f5c64c4779 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:03:00.157272 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc4703b-2e28-475a-a61a-87f5c64c4779 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:03:00.246995 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-8dc4703b-2e28-475a-a61a-87f5c64c4779 None None] MFA Rules not processed for user `2ccb162f8c154aad96f8e71b26406337`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 11:03:00.248268 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-8dc4703b-2e28-475a-a61a-87f5c64c4779 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:03:00.435653 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 512/1028] 10.222.0.18 () {58 vars in 1018 bytes} [Thu Oct 13 11:03:00 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 280 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 13 11:03:04.607752 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c79f30-a12f-440a-ab62-b9ca376b7a47 None None] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:03:04.608299 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c79f30-a12f-440a-ab62-b9ca376b7a47 None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:03:04.608299 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c79f30-a12f-440a-ab62-b9ca376b7a47 None None] PATH_INFO: `/` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:03:04.609590 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 517/1029] 10.222.0.18 () {54 vars in 921 bytes} [Thu Oct 13 11:03:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 11:03:04.615130 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99b4aa2-46e0-40a4-bfc7-0c39c9711e0b None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:03:04.615605 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99b4aa2-46e0-40a4-bfc7-0c39c9711e0b None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:03:04.615691 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99b4aa2-46e0-40a4-bfc7-0c39c9711e0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:03:04.646408 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=59 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:03:04.675484 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:03:04.701717 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-a99b4aa2-46e0-40a4-bfc7-0c39c9711e0b None None] MFA Rules not processed for user `2ccb162f8c154aad96f8e71b26406337`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 11:03:04.702934 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-a99b4aa2-46e0-40a4-bfc7-0c39c9711e0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:03:04.820064 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 513/1030] 10.222.0.18 () {58 vars in 1018 bytes} [Thu Oct 13 11:03:04 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 11:03:06.202921 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4488d3e8-1fd6-439e-bbe8-e237eb77f2e8 None None] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:03:06.203493 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4488d3e8-1fd6-439e-bbe8-e237eb77f2e8 None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:03:06.203627 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4488d3e8-1fd6-439e-bbe8-e237eb77f2e8 None None] PATH_INFO: `/` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:03:06.205077 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 518/1031] 10.222.0.18 () {54 vars in 921 bytes} [Thu Oct 13 11:03:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 11:03:06.210214 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2195dd8-015b-483d-a3cf-f444e6000b77 None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:03:06.210623 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2195dd8-015b-483d-a3cf-f444e6000b77 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:03:06.210840 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2195dd8-015b-483d-a3cf-f444e6000b77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:03:06.320863 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-b2195dd8-015b-483d-a3cf-f444e6000b77 None None] MFA Rules not processed for user `2ccb162f8c154aad96f8e71b26406337`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 11:03:06.322922 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-b2195dd8-015b-483d-a3cf-f444e6000b77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:03:06.371628 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:03:06.439309 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 514/1032] 10.222.0.18 () {58 vars in 1018 bytes} [Thu Oct 13 11:03:06 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 13 11:03:09.976278 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11598f75-dd6a-448a-8558-f97ccca0b71c None None] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:03:09.977246 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11598f75-dd6a-448a-8558-f97ccca0b71c None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:03:09.977532 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11598f75-dd6a-448a-8558-f97ccca0b71c None None] PATH_INFO: `/` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:03:09.979594 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 519/1033] 10.222.0.18 () {54 vars in 927 bytes} [Thu Oct 13 11:03:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 11:03:09.984472 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5aba370-d131-4ca3-847f-48bfdb893a2a None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:03:09.984917 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5aba370-d131-4ca3-847f-48bfdb893a2a None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:03:09.985001 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5aba370-d131-4ca3-847f-48bfdb893a2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:03:10.059148 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-f5aba370-d131-4ca3-847f-48bfdb893a2a None None] MFA Rules not processed for user `8ba31ade43694cf8bf28f7528a9ea179`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 11:03:10.060896 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-f5aba370-d131-4ca3-847f-48bfdb893a2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:03:10.166775 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 515/1034] 10.222.0.18 () {58 vars in 1024 bytes} [Thu Oct 13 11:03:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 11:03:10.474932 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e0bd00-4bb3-4cf7-aaa1-0510f96f160b None None] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:03:10.475439 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e0bd00-4bb3-4cf7-aaa1-0510f96f160b None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:03:10.475917 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e0bd00-4bb3-4cf7-aaa1-0510f96f160b None None] PATH_INFO: `/` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:03:10.477539 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 520/1035] 10.222.0.18 () {54 vars in 961 bytes} [Thu Oct 13 11:03:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 11:03:10.486737 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d923b7bf-55c0-476f-95d9-52c2eb211bf6 None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:03:10.487261 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d923b7bf-55c0-476f-95d9-52c2eb211bf6 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:03:10.487801 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d923b7bf-55c0-476f-95d9-52c2eb211bf6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:03:10.514876 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:03:10.578554 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-d923b7bf-55c0-476f-95d9-52c2eb211bf6 None None] MFA Rules not processed for user `bc5b13f97c0e4a31940b5b73a916af29`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 11:03:10.579739 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-d923b7bf-55c0-476f-95d9-52c2eb211bf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:03:10.713270 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 516/1036] 10.222.0.18 () {58 vars in 1058 bytes} [Thu Oct 13 11:03:10 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 11:03:10.720836 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e0bd00-4bb3-4cf7-aaa1-0510f96f160b None None] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:03:10.722399 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-01e0bd00-4bb3-4cf7-aaa1-0510f96f160b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:03:10.883687 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e0bd00-4bb3-4cf7-aaa1-0510f96f160b None None] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:03:10.963557 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:03:11.017615 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544f1a5b-ae99-40ec-b1d4-a8aa01da6479 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc5b13f97c0e4a31940b5b73a916af29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '112613528384453abe7506465609fbd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:03:11.018288 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544f1a5b-ae99-40ec-b1d4-a8aa01da6479 service nova] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:03:11.018524 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544f1a5b-ae99-40ec-b1d4-a8aa01da6479 service nova] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:03:11.018767 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544f1a5b-ae99-40ec-b1d4-a8aa01da6479 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:03:11.020363 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-544f1a5b-ae99-40ec-b1d4-a8aa01da6479 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:03:11.122834 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-544f1a5b-ae99-40ec-b1d4-a8aa01da6479 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:03:11.124538 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-544f1a5b-ae99-40ec-b1d4-a8aa01da6479 service nova] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:03:11.144225 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 521/1037] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Oct 13 11:03:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 424 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 13 11:03:13.539600 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4323ee-3847-428c-a2bf-e6394cb98cfc None None] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:03:13.539600 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4323ee-3847-428c-a2bf-e6394cb98cfc None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:03:13.540427 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4323ee-3847-428c-a2bf-e6394cb98cfc None None] PATH_INFO: `/` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:03:13.546553 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d181cd-8f12-4cb4-8f06-9bd9bb516ede None None] REQUEST_METHOD: `POST` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:03:13.547157 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d181cd-8f12-4cb4-8f06-9bd9bb516ede None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:03:13.547157 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d181cd-8f12-4cb4-8f06-9bd9bb516ede None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:03:13.549793 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 517/1038] 10.222.0.18 () {54 vars in 927 bytes} [Thu Oct 13 11:03:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 11:03:13.620757 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.auth.core [None req-40d181cd-8f12-4cb4-8f06-9bd9bb516ede None None] MFA Rules not processed for user `8ba31ade43694cf8bf28f7528a9ea179`. Rule list: `[]` (Enabled: `True`). {{(pid=81533) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 11:03:13.621764 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-40d181cd-8f12-4cb4-8f06-9bd9bb516ede None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:03:13.664889 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:03:13.733045 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 522/1039] 10.222.0.18 () {58 vars in 1024 bytes} [Thu Oct 13 11:03:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 11:03:14.021440 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4323ee-3847-428c-a2bf-e6394cb98cfc None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:03:14.022981 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-ce4323ee-3847-428c-a2bf-e6394cb98cfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:03:14.093649 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:03:14.196205 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4323ee-3847-428c-a2bf-e6394cb98cfc None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:03:14.320889 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f549ba4-0701-443b-97a4-a8db967bd253 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc5b13f97c0e4a31940b5b73a916af29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '112613528384453abe7506465609fbd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:03:14.321582 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f549ba4-0701-443b-97a4-a8db967bd253 service nova] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:03:14.321916 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f549ba4-0701-443b-97a4-a8db967bd253 service nova] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:03:14.322247 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f549ba4-0701-443b-97a4-a8db967bd253 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:03:14.323891 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-6f549ba4-0701-443b-97a4-a8db967bd253 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:03:14.348698 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:03:14.420438 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f549ba4-0701-443b-97a4-a8db967bd253 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:03:14.422063 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f549ba4-0701-443b-97a4-a8db967bd253 service nova] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:03:14.440256 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 518/1040] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Oct 13 11:03:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 419 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 13 11:03:16.949173 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf7f95e-dbfe-4954-a0de-f3afa47d2fe4 None None] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:03:16.950013 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf7f95e-dbfe-4954-a0de-f3afa47d2fe4 None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:03:16.950479 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf7f95e-dbfe-4954-a0de-f3afa47d2fe4 None None] PATH_INFO: `/` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:03:16.951834 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 523/1041] 10.222.0.18 () {54 vars in 927 bytes} [Thu Oct 13 11:03:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 11:03:16.957142 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d297530c-bc7a-4346-8791-f7cfda23c7f4 None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:03:16.957553 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d297530c-bc7a-4346-8791-f7cfda23c7f4 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:03:16.957720 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d297530c-bc7a-4346-8791-f7cfda23c7f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:03:17.028234 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-d297530c-bc7a-4346-8791-f7cfda23c7f4 None None] MFA Rules not processed for user `8ba31ade43694cf8bf28f7528a9ea179`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 11:03:17.029480 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-d297530c-bc7a-4346-8791-f7cfda23c7f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:03:17.130835 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:03:17.141156 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 519/1042] 10.222.0.18 () {58 vars in 1024 bytes} [Thu Oct 13 11:03:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 11:03:17.426418 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08739fc-e87e-4aac-84be-3da200f98cf0 None None] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:03:17.426916 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08739fc-e87e-4aac-84be-3da200f98cf0 None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:03:17.427292 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08739fc-e87e-4aac-84be-3da200f98cf0 None None] PATH_INFO: `/` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:03:17.428920 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 524/1043] 10.222.0.18 () {54 vars in 961 bytes} [Thu Oct 13 11:03:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 11:03:17.434623 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab52900-c01e-46d0-bb5d-5b8ddce7cff2 None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:03:17.435030 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab52900-c01e-46d0-bb5d-5b8ddce7cff2 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:03:17.435399 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab52900-c01e-46d0-bb5d-5b8ddce7cff2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:03:17.516594 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-7ab52900-c01e-46d0-bb5d-5b8ddce7cff2 None None] MFA Rules not processed for user `bc5b13f97c0e4a31940b5b73a916af29`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 11:03:17.518250 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-7ab52900-c01e-46d0-bb5d-5b8ddce7cff2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:03:17.642001 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 520/1044] 10.222.0.18 () {58 vars in 1058 bytes} [Thu Oct 13 11:03:17 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 13 11:03:17.650472 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08739fc-e87e-4aac-84be-3da200f98cf0 None None] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:03:17.652107 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-b08739fc-e87e-4aac-84be-3da200f98cf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:03:17.817849 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08739fc-e87e-4aac-84be-3da200f98cf0 None None] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:03:17.840093 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:03:17.942671 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d90e4b-9dbe-4f49-8d9e-026741d049d1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc5b13f97c0e4a31940b5b73a916af29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '112613528384453abe7506465609fbd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:03:17.943545 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d90e4b-9dbe-4f49-8d9e-026741d049d1 service nova] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:03:17.943925 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d90e4b-9dbe-4f49-8d9e-026741d049d1 service nova] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:03:17.944301 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d90e4b-9dbe-4f49-8d9e-026741d049d1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:03:17.946072 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-f4d90e4b-9dbe-4f49-8d9e-026741d049d1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:03:18.043301 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d90e4b-9dbe-4f49-8d9e-026741d049d1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:03:18.045110 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d90e4b-9dbe-4f49-8d9e-026741d049d1 service nova] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:03:18.064169 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 525/1045] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Oct 13 11:03:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 414 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 13 11:03:18.205582 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d042cee-4d48-428a-ab0d-521596ab3fdd None None] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:03:18.206294 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d042cee-4d48-428a-ab0d-521596ab3fdd None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:03:18.206294 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d042cee-4d48-428a-ab0d-521596ab3fdd None None] PATH_INFO: `/` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:03:18.207552 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 521/1046] 10.222.0.18 () {54 vars in 927 bytes} [Thu Oct 13 11:03:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 11:03:18.214339 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36808590-0c62-4cba-a1cd-9bd2b68de1e9 None None] REQUEST_METHOD: `POST` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:03:18.214778 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36808590-0c62-4cba-a1cd-9bd2b68de1e9 None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:03:18.215133 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36808590-0c62-4cba-a1cd-9bd2b68de1e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:03:18.258156 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:03:18.302732 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.auth.core [None req-36808590-0c62-4cba-a1cd-9bd2b68de1e9 None None] MFA Rules not processed for user `8ba31ade43694cf8bf28f7528a9ea179`. Rule list: `[]` (Enabled: `True`). {{(pid=81533) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 11:03:18.304174 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-36808590-0c62-4cba-a1cd-9bd2b68de1e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:03:18.415513 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 526/1047] 10.222.0.18 () {58 vars in 1024 bytes} [Thu Oct 13 11:03:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 11:03:18.755379 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c04cf5-8931-4a62-aa2e-8168014d8fdb None None] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:03:18.755667 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c04cf5-8931-4a62-aa2e-8168014d8fdb None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:03:18.755943 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c04cf5-8931-4a62-aa2e-8168014d8fdb None None] PATH_INFO: `/` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:03:18.757481 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 522/1048] 10.222.0.18 () {54 vars in 963 bytes} [Thu Oct 13 11:03:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 11:03:18.762308 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08767f9b-2684-4c9f-8ea0-9e5b38626dc0 None None] REQUEST_METHOD: `POST` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:03:18.762600 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08767f9b-2684-4c9f-8ea0-9e5b38626dc0 None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:03:18.762877 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08767f9b-2684-4c9f-8ea0-9e5b38626dc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:03:18.846172 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.auth.core [None req-08767f9b-2684-4c9f-8ea0-9e5b38626dc0 None None] MFA Rules not processed for user `5bd577557f564e148ebd1dcde1e8580b`. Rule list: `[]` (Enabled: `True`). {{(pid=81533) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 11:03:18.847395 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-08767f9b-2684-4c9f-8ea0-9e5b38626dc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:03:18.900363 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:03:18.933523 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 527/1049] 10.222.0.18 () {58 vars in 1060 bytes} [Thu Oct 13 11:03:18 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 11:03:18.941384 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c04cf5-8931-4a62-aa2e-8168014d8fdb None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:03:18.942976 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-63c04cf5-8931-4a62-aa2e-8168014d8fdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:03:18.999126 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:03:19.059560 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c04cf5-8931-4a62-aa2e-8168014d8fdb None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:03:19.143128 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3550d7-b8a6-492f-93c3-e40eef7bb7ea service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5bd577557f564e148ebd1dcde1e8580b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '112613528384453abe7506465609fbd8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:03:19.143758 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3550d7-b8a6-492f-93c3-e40eef7bb7ea service cinder] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:03:19.144111 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3550d7-b8a6-492f-93c3-e40eef7bb7ea service cinder] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:03:19.144302 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3550d7-b8a6-492f-93c3-e40eef7bb7ea service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:03:19.145886 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-8b3550d7-b8a6-492f-93c3-e40eef7bb7ea service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:03:19.318038 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:03:19.336032 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3550d7-b8a6-492f-93c3-e40eef7bb7ea service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:03:19.337772 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3550d7-b8a6-492f-93c3-e40eef7bb7ea service cinder] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:03:19.361651 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 523/1050] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Oct 13 11:03:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 421 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 13 11:03:20.326005 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d973dce7-9049-48f9-ae09-14c66cd67a1d None None] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:03:20.326513 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d973dce7-9049-48f9-ae09-14c66cd67a1d None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:03:20.326513 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d973dce7-9049-48f9-ae09-14c66cd67a1d None None] PATH_INFO: `/` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:03:20.327825 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 528/1051] 10.222.0.18 () {54 vars in 927 bytes} [Thu Oct 13 11:03:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 11:03:20.333180 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f790c495-2674-48d1-94ec-f75bb6939f8d None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:03:20.333596 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f790c495-2674-48d1-94ec-f75bb6939f8d None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:03:20.333730 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f790c495-2674-48d1-94ec-f75bb6939f8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:03:20.400799 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-f790c495-2674-48d1-94ec-f75bb6939f8d None None] MFA Rules not processed for user `8ba31ade43694cf8bf28f7528a9ea179`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 11:03:20.402118 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-f790c495-2674-48d1-94ec-f75bb6939f8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:03:20.496843 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 524/1052] 10.222.0.18 () {58 vars in 1024 bytes} [Thu Oct 13 11:03:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 13 11:03:20.787545 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d973dce7-9049-48f9-ae09-14c66cd67a1d None None] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:03:20.789951 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-d973dce7-9049-48f9-ae09-14c66cd67a1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:03:20.962255 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d973dce7-9049-48f9-ae09-14c66cd67a1d None None] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:03:21.016887 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:03:21.080153 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c96364-a78d-4ed0-83f2-40a40974f036 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc5b13f97c0e4a31940b5b73a916af29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '112613528384453abe7506465609fbd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:03:21.080793 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c96364-a78d-4ed0-83f2-40a40974f036 service nova] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:03:21.081100 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c96364-a78d-4ed0-83f2-40a40974f036 service nova] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:03:21.081373 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c96364-a78d-4ed0-83f2-40a40974f036 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:03:21.082997 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-29c96364-a78d-4ed0-83f2-40a40974f036 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:03:21.175595 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c96364-a78d-4ed0-83f2-40a40974f036 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:03:21.177221 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c96364-a78d-4ed0-83f2-40a40974f036 service nova] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:03:21.196743 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 529/1053] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Oct 13 11:03:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 410 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 13 11:03:23.452182 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b54b9d-3751-40a4-bceb-0483f6100962 None None] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:03:23.452753 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b54b9d-3751-40a4-bceb-0483f6100962 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:03:23.452854 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b54b9d-3751-40a4-bceb-0483f6100962 None None] PATH_INFO: `/` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:03:23.454309 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 525/1054] 10.222.0.18 () {54 vars in 927 bytes} [Thu Oct 13 11:03:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 11:03:23.459612 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab37d8d-ac77-48fd-9f69-70de29828cec None None] REQUEST_METHOD: `POST` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:03:23.460065 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab37d8d-ac77-48fd-9f69-70de29828cec None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:03:23.460171 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab37d8d-ac77-48fd-9f69-70de29828cec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:03:23.530370 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.auth.core [None req-eab37d8d-ac77-48fd-9f69-70de29828cec None None] MFA Rules not processed for user `8ba31ade43694cf8bf28f7528a9ea179`. Rule list: `[]` (Enabled: `True`). {{(pid=81533) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 11:03:23.531545 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-eab37d8d-ac77-48fd-9f69-70de29828cec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:03:23.539626 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:03:23.639110 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 530/1055] 10.222.0.18 () {58 vars in 1024 bytes} [Thu Oct 13 11:03:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 11:03:23.932083 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b54b9d-3751-40a4-bceb-0483f6100962 None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:03:23.933780 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-b1b54b9d-3751-40a4-bceb-0483f6100962 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:03:23.999059 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:03:24.091857 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b54b9d-3751-40a4-bceb-0483f6100962 None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:03:24.213365 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90804ee9-82d6-43cf-91b9-f7a97e175d8a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc5b13f97c0e4a31940b5b73a916af29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '112613528384453abe7506465609fbd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:03:24.214124 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90804ee9-82d6-43cf-91b9-f7a97e175d8a service nova] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:03:24.214517 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90804ee9-82d6-43cf-91b9-f7a97e175d8a service nova] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:03:24.214879 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90804ee9-82d6-43cf-91b9-f7a97e175d8a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:03:24.216529 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-90804ee9-82d6-43cf-91b9-f7a97e175d8a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:03:24.236045 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:03:24.318394 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90804ee9-82d6-43cf-91b9-f7a97e175d8a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:03:24.321039 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90804ee9-82d6-43cf-91b9-f7a97e175d8a service nova] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:03:24.341070 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 526/1056] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Oct 13 11:03:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 409 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 13 11:03:26.581681 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f17cf4-ba7f-45eb-84e2-31434181f73e None None] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:03:26.582190 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f17cf4-ba7f-45eb-84e2-31434181f73e None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:03:26.582190 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f17cf4-ba7f-45eb-84e2-31434181f73e None None] PATH_INFO: `/` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:03:26.587581 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 531/1057] 10.222.0.18 () {54 vars in 927 bytes} [Thu Oct 13 11:03:26 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 11:03:26.589903 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf43c00-f43f-4487-9d98-acc7a895a29e None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:03:26.590351 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf43c00-f43f-4487-9d98-acc7a895a29e None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:03:26.590433 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf43c00-f43f-4487-9d98-acc7a895a29e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:03:26.661134 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-7cf43c00-f43f-4487-9d98-acc7a895a29e None None] MFA Rules not processed for user `8ba31ade43694cf8bf28f7528a9ea179`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 11:03:26.662350 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-7cf43c00-f43f-4487-9d98-acc7a895a29e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:03:26.769673 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:03:26.777518 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 527/1058] 10.222.0.18 () {58 vars in 1024 bytes} [Thu Oct 13 11:03:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 11:03:27.074207 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f17cf4-ba7f-45eb-84e2-31434181f73e None None] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:03:27.075721 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-09f17cf4-ba7f-45eb-84e2-31434181f73e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:03:27.217059 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:03:27.228504 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f17cf4-ba7f-45eb-84e2-31434181f73e None None] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:03:27.346428 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649363b5-c72a-43cb-be0f-3bc9b2bfaf4a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc5b13f97c0e4a31940b5b73a916af29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '112613528384453abe7506465609fbd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:03:27.347072 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649363b5-c72a-43cb-be0f-3bc9b2bfaf4a service nova] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:03:27.347354 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649363b5-c72a-43cb-be0f-3bc9b2bfaf4a service nova] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:03:27.347640 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649363b5-c72a-43cb-be0f-3bc9b2bfaf4a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:03:27.349345 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-649363b5-c72a-43cb-be0f-3bc9b2bfaf4a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:03:27.445083 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649363b5-c72a-43cb-be0f-3bc9b2bfaf4a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:03:27.446887 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649363b5-c72a-43cb-be0f-3bc9b2bfaf4a service nova] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:03:27.457107 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:03:27.466215 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 532/1059] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Oct 13 11:03:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 392 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 13 11:03:29.672368 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bf69eb-bc21-40e7-a899-e88658b35138 None None] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:03:29.672904 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bf69eb-bc21-40e7-a899-e88658b35138 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:03:29.672904 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bf69eb-bc21-40e7-a899-e88658b35138 None None] PATH_INFO: `/` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:03:29.674297 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 528/1060] 10.222.0.18 () {54 vars in 927 bytes} [Thu Oct 13 11:03:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 11:03:29.680499 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162619ae-21ca-4da3-9246-858442ac1097 None None] REQUEST_METHOD: `POST` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:03:29.681132 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162619ae-21ca-4da3-9246-858442ac1097 None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:03:29.681132 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162619ae-21ca-4da3-9246-858442ac1097 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:03:29.755479 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.auth.core [None req-162619ae-21ca-4da3-9246-858442ac1097 None None] MFA Rules not processed for user `8ba31ade43694cf8bf28f7528a9ea179`. Rule list: `[]` (Enabled: `True`). {{(pid=81533) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 11:03:29.756721 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-162619ae-21ca-4da3-9246-858442ac1097 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:03:29.855274 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 533/1061] 10.222.0.18 () {58 vars in 1024 bytes} [Thu Oct 13 11:03:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 11:03:30.149614 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22bf69eb-bc21-40e7-a899-e88658b35138 None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:03:30.151138 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-22bf69eb-bc21-40e7-a899-e88658b35138 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:03:30.304016 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22bf69eb-bc21-40e7-a899-e88658b35138 None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:03:30.381472 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:03:30.434252 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4547664d-a1d0-47e3-9d3d-402e1903a4c8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc5b13f97c0e4a31940b5b73a916af29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '112613528384453abe7506465609fbd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:03:30.434855 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4547664d-a1d0-47e3-9d3d-402e1903a4c8 service nova] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:03:30.435133 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4547664d-a1d0-47e3-9d3d-402e1903a4c8 service nova] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:03:30.435404 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4547664d-a1d0-47e3-9d3d-402e1903a4c8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:03:30.436984 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-4547664d-a1d0-47e3-9d3d-402e1903a4c8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:03:30.536939 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4547664d-a1d0-47e3-9d3d-402e1903a4c8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:03:30.539704 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4547664d-a1d0-47e3-9d3d-402e1903a4c8 service nova] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:03:30.561175 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 529/1062] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Oct 13 11:03:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 412 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 13 11:03:33.526753 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f50b3e7-70a6-4339-aa43-3aabb24b832f None None] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:03:33.527455 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f50b3e7-70a6-4339-aa43-3aabb24b832f None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:03:33.527604 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f50b3e7-70a6-4339-aa43-3aabb24b832f None None] PATH_INFO: `/` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:03:33.529418 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 534/1063] 10.222.0.18 () {54 vars in 927 bytes} [Thu Oct 13 11:03:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 11:03:33.536335 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708a94bb-9c21-463d-96a2-71674728bb22 None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:03:33.536815 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708a94bb-9c21-463d-96a2-71674728bb22 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:03:33.537041 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708a94bb-9c21-463d-96a2-71674728bb22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:03:33.621448 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-708a94bb-9c21-463d-96a2-71674728bb22 None None] MFA Rules not processed for user `8ba31ade43694cf8bf28f7528a9ea179`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 11:03:33.623101 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-708a94bb-9c21-463d-96a2-71674728bb22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:03:33.668400 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:03:33.756724 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 530/1064] 10.222.0.18 () {58 vars in 1024 bytes} [Thu Oct 13 11:03:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 11:03:34.105985 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f50b3e7-70a6-4339-aa43-3aabb24b832f None None] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:03:34.107958 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-3f50b3e7-70a6-4339-aa43-3aabb24b832f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:03:34.191657 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:03:34.279547 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f50b3e7-70a6-4339-aa43-3aabb24b832f None None] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:03:34.412374 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e984d117-7134-43e2-b0a5-495ce42d5a8e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc5b13f97c0e4a31940b5b73a916af29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '112613528384453abe7506465609fbd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:03:34.413133 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e984d117-7134-43e2-b0a5-495ce42d5a8e service nova] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:03:34.413488 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e984d117-7134-43e2-b0a5-495ce42d5a8e service nova] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:03:34.413816 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e984d117-7134-43e2-b0a5-495ce42d5a8e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:03:34.415754 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-e984d117-7134-43e2-b0a5-495ce42d5a8e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:03:34.461818 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:03:34.524888 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e984d117-7134-43e2-b0a5-495ce42d5a8e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:03:34.526857 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e984d117-7134-43e2-b0a5-495ce42d5a8e service nova] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:03:34.548514 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 535/1065] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Oct 13 11:03:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 443 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 13 11:03:36.712384 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91aa66cf-4ddc-49f4-844b-1bdb8b9a3d6a None None] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:03:36.712935 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91aa66cf-4ddc-49f4-844b-1bdb8b9a3d6a None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:03:36.712935 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91aa66cf-4ddc-49f4-844b-1bdb8b9a3d6a None None] PATH_INFO: `/` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:03:36.714486 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 531/1066] 10.222.0.18 () {54 vars in 927 bytes} [Thu Oct 13 11:03:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 11:03:36.719918 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113281ab-8951-43eb-b98d-7ddf92750ae8 None None] REQUEST_METHOD: `POST` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:03:36.720432 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113281ab-8951-43eb-b98d-7ddf92750ae8 None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:03:36.720526 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113281ab-8951-43eb-b98d-7ddf92750ae8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:03:36.754944 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9231c0bf-93cd-47c2-9253-7761b58911a6 None None] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:03:36.755224 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9231c0bf-93cd-47c2-9253-7761b58911a6 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:03:36.755503 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9231c0bf-93cd-47c2-9253-7761b58911a6 None None] PATH_INFO: `/` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:03:36.756833 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 532/1067] 10.222.0.18 () {54 vars in 927 bytes} [Thu Oct 13 11:03:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 11:03:36.762787 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbcd2c6-1d23-45ed-8b22-27a4705f8c84 None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:03:36.763072 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbcd2c6-1d23-45ed-8b22-27a4705f8c84 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:03:36.763345 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbcd2c6-1d23-45ed-8b22-27a4705f8c84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:03:36.795536 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.auth.core [None req-113281ab-8951-43eb-b98d-7ddf92750ae8 None None] MFA Rules not processed for user `8ba31ade43694cf8bf28f7528a9ea179`. Rule list: `[]` (Enabled: `True`). {{(pid=81533) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 11:03:36.796773 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-113281ab-8951-43eb-b98d-7ddf92750ae8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:03:36.837170 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-6bbcd2c6-1d23-45ed-8b22-27a4705f8c84 None None] MFA Rules not processed for user `8ba31ade43694cf8bf28f7528a9ea179`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 11:03:36.838405 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-6bbcd2c6-1d23-45ed-8b22-27a4705f8c84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:03:36.904282 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 536/1068] 10.222.0.18 () {58 vars in 1024 bytes} [Thu Oct 13 11:03:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 11:03:36.942213 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 533/1069] 10.222.0.18 () {58 vars in 1024 bytes} [Thu Oct 13 11:03:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 13 11:03:37.208534 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b58ae5-c61a-49c8-a2a5-f6e8e8ef8d66 None None] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:03:37.208889 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b58ae5-c61a-49c8-a2a5-f6e8e8ef8d66 None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:03:37.209252 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b58ae5-c61a-49c8-a2a5-f6e8e8ef8d66 None None] PATH_INFO: `/` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:03:37.211269 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 537/1070] 10.222.0.18 () {54 vars in 962 bytes} [Thu Oct 13 11:03:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 11:03:37.217100 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5739b966-e000-47d5-b243-af69a50ea0b0 None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:03:37.217390 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5739b966-e000-47d5-b243-af69a50ea0b0 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:03:37.217754 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5739b966-e000-47d5-b243-af69a50ea0b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:03:37.228669 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b58ae5-c61a-49c8-a2a5-f6e8e8ef8d66 None None] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:03:37.230215 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-66b58ae5-c61a-49c8-a2a5-f6e8e8ef8d66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:03:37.236591 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:03:37.243996 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:03:37.299421 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-5739b966-e000-47d5-b243-af69a50ea0b0 None None] MFA Rules not processed for user `85a35c31fd1340f79ac67a10b4963b44`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 11:03:37.300626 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-5739b966-e000-47d5-b243-af69a50ea0b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:03:37.375488 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 534/1071] 10.222.0.18 () {58 vars in 1059 bytes} [Thu Oct 13 11:03:37 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 11:03:37.380677 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b58ae5-c61a-49c8-a2a5-f6e8e8ef8d66 None None] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:03:37.384978 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5739b966-e000-47d5-b243-af69a50ea0b0 None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:03:37.392721 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5739b966-e000-47d5-b243-af69a50ea0b0 None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:03:37.469502 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:03:37.471757 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49208bfe-feff-4ad4-a86f-df75757e47da service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85a35c31fd1340f79ac67a10b4963b44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '112613528384453abe7506465609fbd8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:03:37.472443 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49208bfe-feff-4ad4-a86f-df75757e47da service glance] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:03:37.472724 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49208bfe-feff-4ad4-a86f-df75757e47da service glance] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:03:37.472997 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49208bfe-feff-4ad4-a86f-df75757e47da service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:03:37.474622 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-49208bfe-feff-4ad4-a86f-df75757e47da service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:03:37.497148 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64b897f-3d55-4fb2-8db7-4aa93c832ee6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc5b13f97c0e4a31940b5b73a916af29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '112613528384453abe7506465609fbd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:03:37.497757 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64b897f-3d55-4fb2-8db7-4aa93c832ee6 service nova] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:03:37.498039 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64b897f-3d55-4fb2-8db7-4aa93c832ee6 service nova] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:03:37.498312 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64b897f-3d55-4fb2-8db7-4aa93c832ee6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:03:37.499981 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-f64b897f-3d55-4fb2-8db7-4aa93c832ee6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:03:37.504828 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:03:37.593580 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49208bfe-feff-4ad4-a86f-df75757e47da service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:03:37.595032 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49208bfe-feff-4ad4-a86f-df75757e47da service glance] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:03:37.601147 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f64b897f-3d55-4fb2-8db7-4aa93c832ee6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:03:37.602746 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f64b897f-3d55-4fb2-8db7-4aa93c832ee6 service nova] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:03:37.612726 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 535/1072] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Oct 13 11:03:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 228 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 13 11:03:37.621430 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 538/1073] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Oct 13 11:03:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 393 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 13 11:03:38.372566 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7903fb0a-8bd3-419d-989f-c63b59e9dafb None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:03:38.373116 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7903fb0a-8bd3-419d-989f-c63b59e9dafb None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:03:38.373277 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7903fb0a-8bd3-419d-989f-c63b59e9dafb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:03:38.440673 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-7903fb0a-8bd3-419d-989f-c63b59e9dafb None None] MFA Rules not processed for user `ed56f3fe2ddc48ee9882712aadaa2001`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 11:03:38.441907 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-7903fb0a-8bd3-419d-989f-c63b59e9dafb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:03:38.523948 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:03:38.530014 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 536/1074] 10.222.0.18 () {58 vars in 1009 bytes} [Thu Oct 13 11:03:38 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 11:03:38.577616 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c29542-08ea-429d-92a7-c983c9cbc725 None None] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:03:38.578151 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c29542-08ea-429d-92a7-c983c9cbc725 None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:03:38.578287 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c29542-08ea-429d-92a7-c983c9cbc725 None None] PATH_INFO: `/` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:03:38.579851 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 539/1075] 10.222.0.18 () {54 vars in 943 bytes} [Thu Oct 13 11:03:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 11:03:38.586793 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376e8d40-d86d-4212-bf8c-1415a08c2093 None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:03:38.587082 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376e8d40-d86d-4212-bf8c-1415a08c2093 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:03:38.587356 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376e8d40-d86d-4212-bf8c-1415a08c2093 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:03:38.663411 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-376e8d40-d86d-4212-bf8c-1415a08c2093 None None] MFA Rules not processed for user `8fd17114a6034faab30c9003add7199d`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 11:03:38.664679 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-376e8d40-d86d-4212-bf8c-1415a08c2093 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:03:38.775121 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 537/1076] 10.222.0.18 () {58 vars in 1040 bytes} [Thu Oct 13 11:03:38 2022] POST /identity/v3/auth/tokens => generated 3304 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 13 11:03:38.784728 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c29542-08ea-429d-92a7-c983c9cbc725 None None] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:03:38.786308 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-c9c29542-08ea-429d-92a7-c983c9cbc725 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:03:38.884490 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:03:38.925818 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c29542-08ea-429d-92a7-c983c9cbc725 None None] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:03:39.029867 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc6e668-347a-4f8e-843e-51ed23ffa631 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fd17114a6034faab30c9003add7199d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '112613528384453abe7506465609fbd8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:03:39.030387 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc6e668-347a-4f8e-843e-51ed23ffa631 service swift] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:03:39.030663 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc6e668-347a-4f8e-843e-51ed23ffa631 service swift] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:03:39.030935 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc6e668-347a-4f8e-843e-51ed23ffa631 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:03:39.032538 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-ffc6e668-347a-4f8e-843e-51ed23ffa631 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:03:39.115088 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc6e668-347a-4f8e-843e-51ed23ffa631 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:03:39.117202 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc6e668-347a-4f8e-843e-51ed23ffa631 service swift] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:03:39.120764 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:03:39.126343 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 540/1077] 10.222.0.18 () {60 vars in 1384 bytes} [Thu Oct 13 11:03:38 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 13 11:03:39.870771 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df566921-b298-4d2a-b244-204151f0efef None None] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:03:39.871332 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df566921-b298-4d2a-b244-204151f0efef None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:03:39.871649 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df566921-b298-4d2a-b244-204151f0efef None None] PATH_INFO: `/` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:03:39.873353 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 538/1078] 10.222.0.18 () {54 vars in 927 bytes} [Thu Oct 13 11:03:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 11:03:39.878702 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71b5fb2-8d4e-4c26-90bc-80e7438ad9a1 None None] REQUEST_METHOD: `POST` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:03:39.879137 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71b5fb2-8d4e-4c26-90bc-80e7438ad9a1 None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:03:39.879234 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71b5fb2-8d4e-4c26-90bc-80e7438ad9a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:03:39.952314 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.auth.core [None req-c71b5fb2-8d4e-4c26-90bc-80e7438ad9a1 None None] MFA Rules not processed for user `8ba31ade43694cf8bf28f7528a9ea179`. Rule list: `[]` (Enabled: `True`). {{(pid=81533) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 11:03:39.953585 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-c71b5fb2-8d4e-4c26-90bc-80e7438ad9a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:03:40.073127 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 541/1079] 10.222.0.18 () {58 vars in 1024 bytes} [Thu Oct 13 11:03:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 11:03:40.362253 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df566921-b298-4d2a-b244-204151f0efef None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:03:40.363808 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-df566921-b298-4d2a-b244-204151f0efef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:03:40.444698 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:03:40.547007 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df566921-b298-4d2a-b244-204151f0efef None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:03:40.671872 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ac1229-6311-4ab1-88cb-8f49314d6e54 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc5b13f97c0e4a31940b5b73a916af29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '112613528384453abe7506465609fbd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:03:40.672483 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ac1229-6311-4ab1-88cb-8f49314d6e54 service nova] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:03:40.672759 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ac1229-6311-4ab1-88cb-8f49314d6e54 service nova] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:03:40.673050 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ac1229-6311-4ab1-88cb-8f49314d6e54 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:03:40.674636 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-15ac1229-6311-4ab1-88cb-8f49314d6e54 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:03:40.692877 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:03:40.806838 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ac1229-6311-4ab1-88cb-8f49314d6e54 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:03:40.808429 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ac1229-6311-4ab1-88cb-8f49314d6e54 service nova] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:03:40.828007 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 539/1080] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Oct 13 11:03:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 466 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 13 11:03:43.111809 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28237021-5d00-4f3e-ad34-f76a40233181 None None] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:03:43.112419 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28237021-5d00-4f3e-ad34-f76a40233181 None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:03:43.112419 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28237021-5d00-4f3e-ad34-f76a40233181 None None] PATH_INFO: `/` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:03:43.114031 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 542/1081] 10.222.0.18 () {54 vars in 927 bytes} [Thu Oct 13 11:03:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 11:03:43.119853 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd24b734-4820-40ec-adf3-59d96952ce2b None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:03:43.120289 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd24b734-4820-40ec-adf3-59d96952ce2b None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:03:43.120389 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd24b734-4820-40ec-adf3-59d96952ce2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:03:43.191248 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-cd24b734-4820-40ec-adf3-59d96952ce2b None None] MFA Rules not processed for user `8ba31ade43694cf8bf28f7528a9ea179`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 11:03:43.192627 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-cd24b734-4820-40ec-adf3-59d96952ce2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:03:43.289463 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:03:43.298373 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 540/1082] 10.222.0.18 () {58 vars in 1024 bytes} [Thu Oct 13 11:03:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 11:03:43.596023 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28237021-5d00-4f3e-ad34-f76a40233181 None None] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:03:43.597566 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-28237021-5d00-4f3e-ad34-f76a40233181 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:03:43.682035 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:03:43.760336 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28237021-5d00-4f3e-ad34-f76a40233181 None None] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:03:43.885709 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be57139-a341-4ba8-9af9-5a85c3f5f88a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc5b13f97c0e4a31940b5b73a916af29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '112613528384453abe7506465609fbd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:03:43.886324 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be57139-a341-4ba8-9af9-5a85c3f5f88a service nova] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:03:43.886608 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be57139-a341-4ba8-9af9-5a85c3f5f88a service nova] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:03:43.886876 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be57139-a341-4ba8-9af9-5a85c3f5f88a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:03:43.888477 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-0be57139-a341-4ba8-9af9-5a85c3f5f88a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:03:43.935364 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:03:43.993524 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be57139-a341-4ba8-9af9-5a85c3f5f88a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:03:43.995121 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be57139-a341-4ba8-9af9-5a85c3f5f88a service nova] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:03:44.016230 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 543/1083] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Oct 13 11:03:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 421 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 13 11:03:46.237419 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69eac28d-4e40-4266-8052-50cdf0419c39 None None] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:03:46.237983 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69eac28d-4e40-4266-8052-50cdf0419c39 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:03:46.237983 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69eac28d-4e40-4266-8052-50cdf0419c39 None None] PATH_INFO: `/` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:03:46.244018 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 541/1084] 10.222.0.18 () {54 vars in 927 bytes} [Thu Oct 13 11:03:46 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 11:03:46.249306 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71a8fa7-922c-4c53-beec-66302a57eb37 None None] REQUEST_METHOD: `POST` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:03:46.249780 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71a8fa7-922c-4c53-beec-66302a57eb37 None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:03:46.249879 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71a8fa7-922c-4c53-beec-66302a57eb37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:03:46.322095 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.auth.core [None req-d71a8fa7-922c-4c53-beec-66302a57eb37 None None] MFA Rules not processed for user `8ba31ade43694cf8bf28f7528a9ea179`. Rule list: `[]` (Enabled: `True`). {{(pid=81533) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 11:03:46.323661 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-d71a8fa7-922c-4c53-beec-66302a57eb37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:03:46.431184 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 544/1085] 10.222.0.18 () {58 vars in 1024 bytes} [Thu Oct 13 11:03:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 11:03:46.731164 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69eac28d-4e40-4266-8052-50cdf0419c39 None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:03:46.732688 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-69eac28d-4e40-4266-8052-50cdf0419c39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:03:46.900543 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69eac28d-4e40-4266-8052-50cdf0419c39 None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:03:47.058343 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:03:47.090844 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597a47b3-ec1e-4984-9fa0-cdf77a31a00a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc5b13f97c0e4a31940b5b73a916af29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '112613528384453abe7506465609fbd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:03:47.091461 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597a47b3-ec1e-4984-9fa0-cdf77a31a00a service nova] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:03:47.091747 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597a47b3-ec1e-4984-9fa0-cdf77a31a00a service nova] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:03:47.092028 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597a47b3-ec1e-4984-9fa0-cdf77a31a00a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:03:47.093661 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-597a47b3-ec1e-4984-9fa0-cdf77a31a00a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:03:47.218751 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597a47b3-ec1e-4984-9fa0-cdf77a31a00a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:03:47.221336 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597a47b3-ec1e-4984-9fa0-cdf77a31a00a service nova] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:03:47.247201 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 542/1086] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Oct 13 11:03:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 516 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 13 11:03:56.428652 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=93 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:03:57.240544 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=65 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:04:02.264522 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e49118-34d0-4b7b-9064-7d2f35c7411b None None] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:04:02.265117 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e49118-34d0-4b7b-9064-7d2f35c7411b None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:04:02.265117 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e49118-34d0-4b7b-9064-7d2f35c7411b None None] PATH_INFO: `/` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:04:02.266465 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 545/1087] 10.222.0.18 () {54 vars in 918 bytes} [Thu Oct 13 11:04:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 11:04:02.271724 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ec830d-4e69-4f7b-8f23-1f94e1e04d6f None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:04:02.272157 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ec830d-4e69-4f7b-8f23-1f94e1e04d6f None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:04:02.272276 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ec830d-4e69-4f7b-8f23-1f94e1e04d6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:04:02.346563 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-50ec830d-4e69-4f7b-8f23-1f94e1e04d6f None None] MFA Rules not processed for user `2ccb162f8c154aad96f8e71b26406337`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 11:04:02.347761 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-50ec830d-4e69-4f7b-8f23-1f94e1e04d6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:04:02.452027 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 543/1088] 10.222.0.18 () {58 vars in 1015 bytes} [Thu Oct 13 11:04:02 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 11:04:02.466636 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f86066-743f-4034-bc77-46a5fce98bee None None] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:04:02.466922 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f86066-743f-4034-bc77-46a5fce98bee None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:04:02.467219 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f86066-743f-4034-bc77-46a5fce98bee None None] PATH_INFO: `/` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:04:02.468569 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 546/1089] 10.222.0.18 () {54 vars in 918 bytes} [Thu Oct 13 11:04:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 11:04:02.473692 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790c48e9-755b-4c28-986e-de73baa4e6ce None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:04:02.474003 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790c48e9-755b-4c28-986e-de73baa4e6ce None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:04:02.474278 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790c48e9-755b-4c28-986e-de73baa4e6ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:04:02.547104 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:04:02.549480 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-790c48e9-755b-4c28-986e-de73baa4e6ce None None] MFA Rules not processed for user `bc5b13f97c0e4a31940b5b73a916af29`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 11:04:02.551332 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-790c48e9-755b-4c28-986e-de73baa4e6ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:04:02.666141 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 544/1090] 10.222.0.18 () {58 vars in 1015 bytes} [Thu Oct 13 11:04:02 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 11:04:05.241383 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae40c5ee-f3a3-403b-bffa-7f60a07b3b64 None None] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:04:05.241961 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae40c5ee-f3a3-403b-bffa-7f60a07b3b64 None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:04:05.241961 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae40c5ee-f3a3-403b-bffa-7f60a07b3b64 None None] PATH_INFO: `/` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:04:05.244001 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 547/1091] 127.0.0.1 () {54 vars in 917 bytes} [Thu Oct 13 11:04:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 11:04:05.249408 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ac703b-fa03-419d-b930-b3409ce91bb3 None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:04:05.249817 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ac703b-fa03-419d-b930-b3409ce91bb3 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:04:05.249956 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ac703b-fa03-419d-b930-b3409ce91bb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:04:05.316724 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-a0ac703b-fa03-419d-b930-b3409ce91bb3 None None] MFA Rules not processed for user `8ba31ade43694cf8bf28f7528a9ea179`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 11:04:05.317954 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-a0ac703b-fa03-419d-b930-b3409ce91bb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:04:05.372595 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:04:05.415293 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 545/1092] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Oct 13 11:04:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 13 11:04:05.706546 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae40c5ee-f3a3-403b-bffa-7f60a07b3b64 None None] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:04:05.708186 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-ae40c5ee-f3a3-403b-bffa-7f60a07b3b64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:04:05.854132 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae40c5ee-f3a3-403b-bffa-7f60a07b3b64 None None] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:04:05.929499 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:04:05.970122 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45a3be6-fb52-4d75-95cb-0c64256519ab service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc5b13f97c0e4a31940b5b73a916af29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '112613528384453abe7506465609fbd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:04:05.970654 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45a3be6-fb52-4d75-95cb-0c64256519ab service nova] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:04:05.970933 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45a3be6-fb52-4d75-95cb-0c64256519ab service nova] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:04:05.971206 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45a3be6-fb52-4d75-95cb-0c64256519ab service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:04:05.972797 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-c45a3be6-fb52-4d75-95cb-0c64256519ab service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:04:06.061173 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45a3be6-fb52-4d75-95cb-0c64256519ab service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:04:06.062759 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45a3be6-fb52-4d75-95cb-0c64256519ab service nova] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:04:06.080779 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 548/1093] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Oct 13 11:04:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 13 11:04:07.220950 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3aa6bf6-d07b-4e26-a389-07fbc7bd7fc3 None None] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:04:07.221540 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3aa6bf6-d07b-4e26-a389-07fbc7bd7fc3 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:04:07.221540 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3aa6bf6-d07b-4e26-a389-07fbc7bd7fc3 None None] PATH_INFO: `/` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:04:07.222917 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 546/1094] 127.0.0.1 () {54 vars in 901 bytes} [Thu Oct 13 11:04:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 11:04:07.228985 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af32ab6a-2369-4538-affc-74ab119aa0fd None None] REQUEST_METHOD: `POST` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:04:07.229467 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af32ab6a-2369-4538-affc-74ab119aa0fd None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:04:07.229577 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af32ab6a-2369-4538-affc-74ab119aa0fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:04:07.303986 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.auth.core [None req-af32ab6a-2369-4538-affc-74ab119aa0fd None None] MFA Rules not processed for user `8ba31ade43694cf8bf28f7528a9ea179`. Rule list: `[]` (Enabled: `True`). {{(pid=81533) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 11:04:07.305838 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-af32ab6a-2369-4538-affc-74ab119aa0fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:04:07.332395 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:04:07.401584 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 549/1095] 127.0.0.1 () {58 vars in 998 bytes} [Thu Oct 13 11:04:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 11:04:07.551801 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3aa6bf6-d07b-4e26-a389-07fbc7bd7fc3 None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:04:07.553339 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-f3aa6bf6-d07b-4e26-a389-07fbc7bd7fc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:04:07.699288 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3aa6bf6-d07b-4e26-a389-07fbc7bd7fc3 None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:04:07.738812 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:04:07.810879 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0c2fac-c263-4cd2-8009-9c537df2cab1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc5b13f97c0e4a31940b5b73a916af29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '112613528384453abe7506465609fbd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:04:07.811388 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0c2fac-c263-4cd2-8009-9c537df2cab1 service nova] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:04:07.811672 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0c2fac-c263-4cd2-8009-9c537df2cab1 service nova] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:04:07.811939 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0c2fac-c263-4cd2-8009-9c537df2cab1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:04:07.813551 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-9e0c2fac-c263-4cd2-8009-9c537df2cab1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:04:07.902586 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0c2fac-c263-4cd2-8009-9c537df2cab1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:04:07.904211 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0c2fac-c263-4cd2-8009-9c537df2cab1 service nova] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:04:07.921691 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 547/1096] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Oct 13 11:04:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 13 11:04:09.055653 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d300dde-6d30-4832-9c47-761ed687c0aa None None] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:04:09.056194 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d300dde-6d30-4832-9c47-761ed687c0aa None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:04:09.056194 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d300dde-6d30-4832-9c47-761ed687c0aa None None] PATH_INFO: `/` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:04:09.057504 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 550/1097] 127.0.0.1 () {54 vars in 901 bytes} [Thu Oct 13 11:04:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 11:04:09.063824 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b73b730-70eb-4047-94bb-8a7d3af80d40 None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:04:09.064281 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b73b730-70eb-4047-94bb-8a7d3af80d40 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:04:09.064389 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b73b730-70eb-4047-94bb-8a7d3af80d40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:04:09.118653 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:04:09.140726 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-7b73b730-70eb-4047-94bb-8a7d3af80d40 None None] MFA Rules not processed for user `8ba31ade43694cf8bf28f7528a9ea179`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 11:04:09.141961 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-7b73b730-70eb-4047-94bb-8a7d3af80d40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:04:09.237858 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 548/1098] 127.0.0.1 () {58 vars in 998 bytes} [Thu Oct 13 11:04:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 11:04:09.404862 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d300dde-6d30-4832-9c47-761ed687c0aa None None] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:04:09.406427 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-4d300dde-6d30-4832-9c47-761ed687c0aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:04:09.549628 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d300dde-6d30-4832-9c47-761ed687c0aa None None] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:04:09.561799 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:04:09.661508 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5584c1-e3e9-4820-a5a9-cc51faa62f58 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc5b13f97c0e4a31940b5b73a916af29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '112613528384453abe7506465609fbd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:04:09.662110 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5584c1-e3e9-4820-a5a9-cc51faa62f58 service nova] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:04:09.662384 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5584c1-e3e9-4820-a5a9-cc51faa62f58 service nova] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:04:09.662655 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5584c1-e3e9-4820-a5a9-cc51faa62f58 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:04:09.664410 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-5f5584c1-e3e9-4820-a5a9-cc51faa62f58 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:04:09.759991 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5584c1-e3e9-4820-a5a9-cc51faa62f58 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:04:09.761628 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5584c1-e3e9-4820-a5a9-cc51faa62f58 service nova] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:04:09.779306 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 551/1099] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Oct 13 11:04:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 13 11:04:10.886111 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c28a10-b685-47c5-a28d-8726ab592fc0 None None] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:04:10.886671 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c28a10-b685-47c5-a28d-8726ab592fc0 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:04:10.886671 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c28a10-b685-47c5-a28d-8726ab592fc0 None None] PATH_INFO: `/` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:04:10.888058 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 549/1100] 127.0.0.1 () {54 vars in 901 bytes} [Thu Oct 13 11:04:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 11:04:10.894311 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9368fe2c-5cb1-4f67-9863-367bf61380a4 None None] REQUEST_METHOD: `POST` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:04:10.894780 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9368fe2c-5cb1-4f67-9863-367bf61380a4 None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:04:10.894885 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9368fe2c-5cb1-4f67-9863-367bf61380a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:04:10.915575 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:04:10.971565 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.auth.core [None req-9368fe2c-5cb1-4f67-9863-367bf61380a4 None None] MFA Rules not processed for user `8ba31ade43694cf8bf28f7528a9ea179`. Rule list: `[]` (Enabled: `True`). {{(pid=81533) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 11:04:10.972769 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-9368fe2c-5cb1-4f67-9863-367bf61380a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:04:11.071054 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 552/1101] 127.0.0.1 () {58 vars in 998 bytes} [Thu Oct 13 11:04:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 11:04:11.221079 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c28a10-b685-47c5-a28d-8726ab592fc0 None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:04:11.222598 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-b3c28a10-b685-47c5-a28d-8726ab592fc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:04:11.331357 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:04:11.368462 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c28a10-b685-47c5-a28d-8726ab592fc0 None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:04:11.481770 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86873a9f-f37b-42a2-b1fe-3f35ccc92183 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc5b13f97c0e4a31940b5b73a916af29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '112613528384453abe7506465609fbd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:04:11.482360 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86873a9f-f37b-42a2-b1fe-3f35ccc92183 service nova] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:04:11.482632 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86873a9f-f37b-42a2-b1fe-3f35ccc92183 service nova] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:04:11.483011 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86873a9f-f37b-42a2-b1fe-3f35ccc92183 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:04:11.484572 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-86873a9f-f37b-42a2-b1fe-3f35ccc92183 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:04:11.561163 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:04:11.578951 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86873a9f-f37b-42a2-b1fe-3f35ccc92183 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:04:11.580527 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86873a9f-f37b-42a2-b1fe-3f35ccc92183 service nova] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:04:11.598755 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 550/1102] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Oct 13 11:04:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 13 11:04:12.743815 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9137effb-40cc-494c-ad6f-36c831f4e7c5 None None] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:04:12.743815 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9137effb-40cc-494c-ad6f-36c831f4e7c5 None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:04:12.743815 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9137effb-40cc-494c-ad6f-36c831f4e7c5 None None] PATH_INFO: `/` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:04:12.743815 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 553/1103] 127.0.0.1 () {54 vars in 901 bytes} [Thu Oct 13 11:04:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 11:04:12.745218 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a263b291-7b54-45f0-9bcf-8c07bb644af2 None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:04:12.745625 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a263b291-7b54-45f0-9bcf-8c07bb644af2 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:04:12.745814 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a263b291-7b54-45f0-9bcf-8c07bb644af2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:04:12.822860 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-a263b291-7b54-45f0-9bcf-8c07bb644af2 None None] MFA Rules not processed for user `8ba31ade43694cf8bf28f7528a9ea179`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 11:04:12.823966 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-a263b291-7b54-45f0-9bcf-8c07bb644af2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:04:12.918901 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 551/1104] 127.0.0.1 () {58 vars in 998 bytes} [Thu Oct 13 11:04:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 11:04:13.071780 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9137effb-40cc-494c-ad6f-36c831f4e7c5 None None] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:04:13.073438 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-9137effb-40cc-494c-ad6f-36c831f4e7c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:04:13.157492 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:04:13.218559 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9137effb-40cc-494c-ad6f-36c831f4e7c5 None None] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:04:13.329546 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8af5045-9896-4f5c-9219-1f5131c9ea16 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc5b13f97c0e4a31940b5b73a916af29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '112613528384453abe7506465609fbd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:04:13.330074 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8af5045-9896-4f5c-9219-1f5131c9ea16 service nova] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:04:13.330351 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8af5045-9896-4f5c-9219-1f5131c9ea16 service nova] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:04:13.330620 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8af5045-9896-4f5c-9219-1f5131c9ea16 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:04:13.332203 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-e8af5045-9896-4f5c-9219-1f5131c9ea16 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:04:13.380590 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:04:13.421129 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8af5045-9896-4f5c-9219-1f5131c9ea16 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:04:13.422702 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8af5045-9896-4f5c-9219-1f5131c9ea16 service nova] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:04:13.440417 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 554/1105] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Oct 13 11:04:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 13 11:04:14.501154 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa46a180-cb2e-420b-a234-52daa056172e None None] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:04:14.501708 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa46a180-cb2e-420b-a234-52daa056172e None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:04:14.501708 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa46a180-cb2e-420b-a234-52daa056172e None None] PATH_INFO: `/` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:04:14.503131 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 552/1106] 127.0.0.1 () {54 vars in 901 bytes} [Thu Oct 13 11:04:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 11:04:14.510312 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de69c02b-4d28-406e-8314-e626dbb21c44 None None] REQUEST_METHOD: `POST` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:04:14.510743 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de69c02b-4d28-406e-8314-e626dbb21c44 None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:04:14.510843 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de69c02b-4d28-406e-8314-e626dbb21c44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:04:14.585633 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.auth.core [None req-de69c02b-4d28-406e-8314-e626dbb21c44 None None] MFA Rules not processed for user `8ba31ade43694cf8bf28f7528a9ea179`. Rule list: `[]` (Enabled: `True`). {{(pid=81533) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 11:04:14.587339 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-de69c02b-4d28-406e-8314-e626dbb21c44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:04:14.684573 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 555/1107] 127.0.0.1 () {58 vars in 998 bytes} [Thu Oct 13 11:04:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 11:04:14.835431 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa46a180-cb2e-420b-a234-52daa056172e None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:04:14.837587 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-aa46a180-cb2e-420b-a234-52daa056172e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:04:14.885638 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:04:14.982766 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa46a180-cb2e-420b-a234-52daa056172e None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:04:15.094248 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ea832e-056f-4856-b126-1850dfbed449 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc5b13f97c0e4a31940b5b73a916af29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '112613528384453abe7506465609fbd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:04:15.094763 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ea832e-056f-4856-b126-1850dfbed449 service nova] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:04:15.095035 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ea832e-056f-4856-b126-1850dfbed449 service nova] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:04:15.095300 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ea832e-056f-4856-b126-1850dfbed449 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:04:15.096853 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-50ea832e-056f-4856-b126-1850dfbed449 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:04:15.104011 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:04:15.187107 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ea832e-056f-4856-b126-1850dfbed449 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:04:15.188664 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ea832e-056f-4856-b126-1850dfbed449 service nova] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:04:15.206875 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 553/1108] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Oct 13 11:04:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 13 11:04:16.262668 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af6d8fe-8028-4249-97e3-76b3c682ca8f None None] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:04:16.263212 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af6d8fe-8028-4249-97e3-76b3c682ca8f None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:04:16.263212 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af6d8fe-8028-4249-97e3-76b3c682ca8f None None] PATH_INFO: `/` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:04:16.264565 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 556/1109] 127.0.0.1 () {54 vars in 901 bytes} [Thu Oct 13 11:04:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 11:04:16.270895 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14729f16-7973-4115-a1dc-14a6004e61f1 None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:04:16.271342 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14729f16-7973-4115-a1dc-14a6004e61f1 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:04:16.271471 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14729f16-7973-4115-a1dc-14a6004e61f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:04:16.347585 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-14729f16-7973-4115-a1dc-14a6004e61f1 None None] MFA Rules not processed for user `8ba31ade43694cf8bf28f7528a9ea179`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 11:04:16.348784 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-14729f16-7973-4115-a1dc-14a6004e61f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:04:16.416245 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:04:16.445068 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 554/1110] 127.0.0.1 () {58 vars in 998 bytes} [Thu Oct 13 11:04:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 11:04:16.595632 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af6d8fe-8028-4249-97e3-76b3c682ca8f None None] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:04:16.597085 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-4af6d8fe-8028-4249-97e3-76b3c682ca8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:04:16.615815 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:04:16.742624 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af6d8fe-8028-4249-97e3-76b3c682ca8f None None] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:04:16.835202 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:04:16.861507 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f17110f-e025-48e8-9d3f-5fb07062fd18 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc5b13f97c0e4a31940b5b73a916af29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '112613528384453abe7506465609fbd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:04:16.862047 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f17110f-e025-48e8-9d3f-5fb07062fd18 service nova] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:04:16.862326 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f17110f-e025-48e8-9d3f-5fb07062fd18 service nova] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:04:16.862598 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f17110f-e025-48e8-9d3f-5fb07062fd18 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:04:16.864195 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-6f17110f-e025-48e8-9d3f-5fb07062fd18 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:04:16.952254 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f17110f-e025-48e8-9d3f-5fb07062fd18 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:04:16.953879 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f17110f-e025-48e8-9d3f-5fb07062fd18 service nova] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:04:16.972078 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 557/1111] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Oct 13 11:04:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 13 11:04:18.033252 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fad9c0d-8f24-4a56-9879-50736d27acf3 None None] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:04:18.033788 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fad9c0d-8f24-4a56-9879-50736d27acf3 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:04:18.033788 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fad9c0d-8f24-4a56-9879-50736d27acf3 None None] PATH_INFO: `/` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:04:18.035035 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 555/1112] 127.0.0.1 () {54 vars in 901 bytes} [Thu Oct 13 11:04:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 11:04:18.041469 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670da0eb-15e7-46ba-824c-5635ea76f1b8 None None] REQUEST_METHOD: `POST` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:04:18.041932 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670da0eb-15e7-46ba-824c-5635ea76f1b8 None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:04:18.042030 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670da0eb-15e7-46ba-824c-5635ea76f1b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:04:18.116062 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.auth.core [None req-670da0eb-15e7-46ba-824c-5635ea76f1b8 None None] MFA Rules not processed for user `8ba31ade43694cf8bf28f7528a9ea179`. Rule list: `[]` (Enabled: `True`). {{(pid=81533) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 11:04:18.117780 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-670da0eb-15e7-46ba-824c-5635ea76f1b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:04:18.159997 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:04:18.214953 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 558/1113] 127.0.0.1 () {58 vars in 998 bytes} [Thu Oct 13 11:04:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 11:04:18.365661 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fad9c0d-8f24-4a56-9879-50736d27acf3 None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:04:18.367166 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-5fad9c0d-8f24-4a56-9879-50736d27acf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:04:18.512198 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fad9c0d-8f24-4a56-9879-50736d27acf3 None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:04:18.566260 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:04:18.625228 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2fb467f-d520-482a-8a63-ae4f741a0da4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc5b13f97c0e4a31940b5b73a916af29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '112613528384453abe7506465609fbd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:04:18.625856 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fb467f-d520-482a-8a63-ae4f741a0da4 service nova] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:04:18.626130 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fb467f-d520-482a-8a63-ae4f741a0da4 service nova] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:04:18.626396 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fb467f-d520-482a-8a63-ae4f741a0da4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:04:18.627973 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-b2fb467f-d520-482a-8a63-ae4f741a0da4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:04:18.717651 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2fb467f-d520-482a-8a63-ae4f741a0da4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:04:18.719229 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2fb467f-d520-482a-8a63-ae4f741a0da4 service nova] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:04:18.737702 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 556/1114] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Oct 13 11:04:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 13 11:04:19.804112 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0d6fe8-036d-4345-8d4b-4ea3514156ce None None] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:04:19.804674 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0d6fe8-036d-4345-8d4b-4ea3514156ce None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:04:19.804674 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0d6fe8-036d-4345-8d4b-4ea3514156ce None None] PATH_INFO: `/` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:04:19.806454 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 559/1115] 127.0.0.1 () {54 vars in 901 bytes} [Thu Oct 13 11:04:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 11:04:19.812770 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89815a2e-cd33-4d23-be4b-46ad4bb92577 None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:04:19.813289 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89815a2e-cd33-4d23-be4b-46ad4bb92577 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:04:19.813392 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89815a2e-cd33-4d23-be4b-46ad4bb92577 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:04:19.891211 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-89815a2e-cd33-4d23-be4b-46ad4bb92577 None None] MFA Rules not processed for user `8ba31ade43694cf8bf28f7528a9ea179`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 11:04:19.892421 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-89815a2e-cd33-4d23-be4b-46ad4bb92577 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:04:19.894519 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:04:19.991021 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 557/1116] 127.0.0.1 () {58 vars in 998 bytes} [Thu Oct 13 11:04:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 11:04:20.142223 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0d6fe8-036d-4345-8d4b-4ea3514156ce None None] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:04:20.143761 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-9d0d6fe8-036d-4345-8d4b-4ea3514156ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:04:20.293777 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0d6fe8-036d-4345-8d4b-4ea3514156ce None None] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:04:20.321302 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:04:20.408270 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1df1be-86b7-4817-9e6f-bd92a3beea1b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc5b13f97c0e4a31940b5b73a916af29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '112613528384453abe7506465609fbd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:04:20.408872 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1df1be-86b7-4817-9e6f-bd92a3beea1b service nova] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:04:20.409183 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1df1be-86b7-4817-9e6f-bd92a3beea1b service nova] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:04:20.409461 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1df1be-86b7-4817-9e6f-bd92a3beea1b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:04:20.411052 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-8e1df1be-86b7-4817-9e6f-bd92a3beea1b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:04:20.500015 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1df1be-86b7-4817-9e6f-bd92a3beea1b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:04:20.501665 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1df1be-86b7-4817-9e6f-bd92a3beea1b service nova] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:04:20.518981 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 560/1117] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Oct 13 11:04:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 13 11:04:22.583811 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1c8a9d-50d7-478a-ac08-e5204ef18368 None None] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:04:22.584247 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1c8a9d-50d7-478a-ac08-e5204ef18368 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:04:22.584363 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1c8a9d-50d7-478a-ac08-e5204ef18368 None None] PATH_INFO: `/` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:04:22.585713 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 558/1118] 127.0.0.1 () {54 vars in 917 bytes} [Thu Oct 13 11:04:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 11:04:22.591549 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd2ef5e-1ce9-486f-b304-682e46346b03 None None] REQUEST_METHOD: `POST` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:04:22.591976 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd2ef5e-1ce9-486f-b304-682e46346b03 None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:04:22.592106 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd2ef5e-1ce9-486f-b304-682e46346b03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:04:22.632486 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:04:22.658372 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.auth.core [None req-fbd2ef5e-1ce9-486f-b304-682e46346b03 None None] MFA Rules not processed for user `8ba31ade43694cf8bf28f7528a9ea179`. Rule list: `[]` (Enabled: `True`). {{(pid=81533) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 11:04:22.659564 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-fbd2ef5e-1ce9-486f-b304-682e46346b03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:04:22.755790 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 561/1119] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Oct 13 11:04:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 11:04:23.042630 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1c8a9d-50d7-478a-ac08-e5204ef18368 None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:04:23.044156 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-3b1c8a9d-50d7-478a-ac08-e5204ef18368 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:04:23.147140 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1c8a9d-50d7-478a-ac08-e5204ef18368 None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:04:23.178622 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:04:23.221171 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e877af-6d93-42ba-bde2-325d91660db3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d31effc2bc44d698b5adb5254263dc5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '112613528384453abe7506465609fbd8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:04:23.221766 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e877af-6d93-42ba-bde2-325d91660db3 service neutron] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:04:23.222042 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e877af-6d93-42ba-bde2-325d91660db3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:04:23.222312 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e877af-6d93-42ba-bde2-325d91660db3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:04:23.223873 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-c6e877af-6d93-42ba-bde2-325d91660db3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:04:23.329706 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e877af-6d93-42ba-bde2-325d91660db3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:04:23.331054 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e877af-6d93-42ba-bde2-325d91660db3 service neutron] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:04:23.349398 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 559/1120] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Oct 13 11:04:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 13 11:04:25.709506 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce4d5cb-a84f-4d07-b73c-ba988fcd7883 None None] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:04:25.710050 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce4d5cb-a84f-4d07-b73c-ba988fcd7883 None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:04:25.710050 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce4d5cb-a84f-4d07-b73c-ba988fcd7883 None None] PATH_INFO: `/` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:04:25.711506 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 562/1121] 127.0.0.1 () {54 vars in 917 bytes} [Thu Oct 13 11:04:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 11:04:25.716652 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0ad79d-ad82-42c5-868f-94f3c0f43ed3 None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:04:25.717113 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0ad79d-ad82-42c5-868f-94f3c0f43ed3 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:04:25.717220 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0ad79d-ad82-42c5-868f-94f3c0f43ed3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:04:25.783244 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-1d0ad79d-ad82-42c5-868f-94f3c0f43ed3 None None] MFA Rules not processed for user `8ba31ade43694cf8bf28f7528a9ea179`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 11:04:25.784444 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-1d0ad79d-ad82-42c5-868f-94f3c0f43ed3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:04:25.797548 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:04:25.879724 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 560/1122] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Oct 13 11:04:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 11:04:26.166367 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce4d5cb-a84f-4d07-b73c-ba988fcd7883 None None] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:04:26.167927 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-2ce4d5cb-a84f-4d07-b73c-ba988fcd7883 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:04:26.277149 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce4d5cb-a84f-4d07-b73c-ba988fcd7883 None None] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:04:26.290390 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:04:26.351383 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec6a7e3-58e0-4e41-ae49-d2fbd3eeb5d2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d31effc2bc44d698b5adb5254263dc5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '112613528384453abe7506465609fbd8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:04:26.353155 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec6a7e3-58e0-4e41-ae49-d2fbd3eeb5d2 service neutron] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:04:26.353429 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec6a7e3-58e0-4e41-ae49-d2fbd3eeb5d2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:04:26.353696 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec6a7e3-58e0-4e41-ae49-d2fbd3eeb5d2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:04:26.355262 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-3ec6a7e3-58e0-4e41-ae49-d2fbd3eeb5d2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:04:26.463076 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec6a7e3-58e0-4e41-ae49-d2fbd3eeb5d2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:04:26.464428 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec6a7e3-58e0-4e41-ae49-d2fbd3eeb5d2 service neutron] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:04:26.481821 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 563/1123] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Oct 13 11:04:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 13 11:04:28.934484 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5268f28-d723-45fd-8735-cacdceeb07ea None None] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:04:28.934993 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5268f28-d723-45fd-8735-cacdceeb07ea None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:04:28.935093 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5268f28-d723-45fd-8735-cacdceeb07ea None None] PATH_INFO: `/` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:04:28.936397 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 561/1124] 127.0.0.1 () {54 vars in 917 bytes} [Thu Oct 13 11:04:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 11:04:28.941620 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a4dfd5-c862-4682-8d00-2b63438fabbe None None] REQUEST_METHOD: `POST` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:04:28.942050 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a4dfd5-c862-4682-8d00-2b63438fabbe None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:04:28.942173 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a4dfd5-c862-4682-8d00-2b63438fabbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:04:28.990485 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:04:29.008822 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.auth.core [None req-07a4dfd5-c862-4682-8d00-2b63438fabbe None None] MFA Rules not processed for user `8ba31ade43694cf8bf28f7528a9ea179`. Rule list: `[]` (Enabled: `True`). {{(pid=81533) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 11:04:29.010039 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-07a4dfd5-c862-4682-8d00-2b63438fabbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:04:29.105298 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 564/1125] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Oct 13 11:04:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 11:04:29.388138 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5268f28-d723-45fd-8735-cacdceeb07ea None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:04:29.389708 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-b5268f28-d723-45fd-8735-cacdceeb07ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:04:29.492746 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5268f28-d723-45fd-8735-cacdceeb07ea None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:04:29.533207 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:04:29.566811 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8106bf67-252c-491a-8ef7-718552d3455b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d31effc2bc44d698b5adb5254263dc5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '112613528384453abe7506465609fbd8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:04:29.567409 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8106bf67-252c-491a-8ef7-718552d3455b service neutron] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:04:29.567688 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8106bf67-252c-491a-8ef7-718552d3455b service neutron] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:04:29.567960 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8106bf67-252c-491a-8ef7-718552d3455b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:04:29.569596 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-8106bf67-252c-491a-8ef7-718552d3455b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:04:29.677660 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8106bf67-252c-491a-8ef7-718552d3455b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:04:29.679084 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8106bf67-252c-491a-8ef7-718552d3455b service neutron] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:04:29.697063 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 562/1126] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Oct 13 11:04:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 13 11:04:31.966019 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4df2257-7e22-4af8-9a45-c3135e34b15d None None] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:04:31.966586 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4df2257-7e22-4af8-9a45-c3135e34b15d None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:04:31.966586 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4df2257-7e22-4af8-9a45-c3135e34b15d None None] PATH_INFO: `/` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:04:31.967908 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 565/1127] 127.0.0.1 () {54 vars in 917 bytes} [Thu Oct 13 11:04:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 11:04:31.973141 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c78d38-900b-4feb-a4fb-01b7b807834c None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:04:31.973543 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c78d38-900b-4feb-a4fb-01b7b807834c None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:04:31.973709 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c78d38-900b-4feb-a4fb-01b7b807834c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:04:32.040258 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-f8c78d38-900b-4feb-a4fb-01b7b807834c None None] MFA Rules not processed for user `8ba31ade43694cf8bf28f7528a9ea179`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 11:04:32.041426 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-f8c78d38-900b-4feb-a4fb-01b7b807834c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:04:32.062346 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:04:32.137799 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 563/1128] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Oct 13 11:04:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 11:04:32.421513 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4df2257-7e22-4af8-9a45-c3135e34b15d None None] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:04:32.423046 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-c4df2257-7e22-4af8-9a45-c3135e34b15d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:04:32.526810 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4df2257-7e22-4af8-9a45-c3135e34b15d None None] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:04:32.547062 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:04:32.599327 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fdd8230-6cc4-420e-9cb2-8876d8276d07 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d31effc2bc44d698b5adb5254263dc5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '112613528384453abe7506465609fbd8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:04:32.599925 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdd8230-6cc4-420e-9cb2-8876d8276d07 service neutron] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:04:32.600205 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdd8230-6cc4-420e-9cb2-8876d8276d07 service neutron] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:04:32.600478 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdd8230-6cc4-420e-9cb2-8876d8276d07 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:04:32.602622 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-0fdd8230-6cc4-420e-9cb2-8876d8276d07 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:04:32.708427 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fdd8230-6cc4-420e-9cb2-8876d8276d07 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:04:32.709879 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fdd8230-6cc4-420e-9cb2-8876d8276d07 service neutron] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:04:32.727888 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 566/1129] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Oct 13 11:04:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 13 11:04:34.939308 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd30d51-79b6-4441-aef8-7722b3c1abbb None None] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:04:34.939892 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd30d51-79b6-4441-aef8-7722b3c1abbb None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:04:34.939892 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd30d51-79b6-4441-aef8-7722b3c1abbb None None] PATH_INFO: `/` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:04:34.941224 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 564/1130] 127.0.0.1 () {54 vars in 917 bytes} [Thu Oct 13 11:04:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 11:04:34.946546 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019ae082-86d2-4f2c-8c16-0c1886492017 None None] REQUEST_METHOD: `POST` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:04:34.946997 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019ae082-86d2-4f2c-8c16-0c1886492017 None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:04:34.947122 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019ae082-86d2-4f2c-8c16-0c1886492017 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:04:35.010441 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:04:35.013505 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.auth.core [None req-019ae082-86d2-4f2c-8c16-0c1886492017 None None] MFA Rules not processed for user `8ba31ade43694cf8bf28f7528a9ea179`. Rule list: `[]` (Enabled: `True`). {{(pid=81533) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 11:04:35.015046 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-019ae082-86d2-4f2c-8c16-0c1886492017 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:04:35.110515 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 567/1131] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Oct 13 11:04:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 13 11:04:35.403257 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd30d51-79b6-4441-aef8-7722b3c1abbb None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:04:35.404787 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-edd30d51-79b6-4441-aef8-7722b3c1abbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:04:35.508640 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd30d51-79b6-4441-aef8-7722b3c1abbb None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:04:35.557643 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:04:35.581710 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a49ff0c-8e58-4406-af0e-4171a04e4178 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d31effc2bc44d698b5adb5254263dc5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '112613528384453abe7506465609fbd8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:04:35.582309 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a49ff0c-8e58-4406-af0e-4171a04e4178 service neutron] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:04:35.582585 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a49ff0c-8e58-4406-af0e-4171a04e4178 service neutron] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:04:35.582855 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a49ff0c-8e58-4406-af0e-4171a04e4178 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:04:35.584426 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-9a49ff0c-8e58-4406-af0e-4171a04e4178 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:04:35.692680 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a49ff0c-8e58-4406-af0e-4171a04e4178 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:04:35.694110 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a49ff0c-8e58-4406-af0e-4171a04e4178 service neutron] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:04:35.711779 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 565/1132] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Oct 13 11:04:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 13 11:04:37.928475 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a55926-2de0-4e59-b3e7-48b247f19d81 None None] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:04:37.929680 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a55926-2de0-4e59-b3e7-48b247f19d81 None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:04:37.929825 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a55926-2de0-4e59-b3e7-48b247f19d81 None None] PATH_INFO: `/` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:04:37.931184 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 568/1133] 127.0.0.1 () {54 vars in 917 bytes} [Thu Oct 13 11:04:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 11:04:37.936460 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b17612-c3ed-4830-893f-e06df60260c3 None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:04:37.936997 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b17612-c3ed-4830-893f-e06df60260c3 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:04:37.936997 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b17612-c3ed-4830-893f-e06df60260c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:04:38.002091 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-21b17612-c3ed-4830-893f-e06df60260c3 None None] MFA Rules not processed for user `8ba31ade43694cf8bf28f7528a9ea179`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 11:04:38.003278 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-21b17612-c3ed-4830-893f-e06df60260c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:04:38.031911 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:04:38.098650 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 566/1134] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Oct 13 11:04:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 13 11:04:38.397482 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a55926-2de0-4e59-b3e7-48b247f19d81 None None] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:04:38.399124 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-55a55926-2de0-4e59-b3e7-48b247f19d81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:04:38.502387 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a55926-2de0-4e59-b3e7-48b247f19d81 None None] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:04:38.530359 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:04:38.575529 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d45e9f-58c9-4344-8fe0-de3de28f4e79 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d31effc2bc44d698b5adb5254263dc5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '112613528384453abe7506465609fbd8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:04:38.576058 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d45e9f-58c9-4344-8fe0-de3de28f4e79 service neutron] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:04:38.576331 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d45e9f-58c9-4344-8fe0-de3de28f4e79 service neutron] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:04:38.576624 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d45e9f-58c9-4344-8fe0-de3de28f4e79 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:04:38.578248 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-04d45e9f-58c9-4344-8fe0-de3de28f4e79 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:04:38.685830 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d45e9f-58c9-4344-8fe0-de3de28f4e79 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:04:38.687269 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d45e9f-58c9-4344-8fe0-de3de28f4e79 service neutron] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:04:38.704810 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 569/1135] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Oct 13 11:04:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 13 11:04:40.917195 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3c7411-14dc-4465-b749-0bbeba363244 None None] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:04:40.917754 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3c7411-14dc-4465-b749-0bbeba363244 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:04:40.917754 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3c7411-14dc-4465-b749-0bbeba363244 None None] PATH_INFO: `/` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:04:40.919394 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 567/1136] 127.0.0.1 () {54 vars in 917 bytes} [Thu Oct 13 11:04:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 11:04:40.924457 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996c9171-2c2c-4024-9de6-e74950648e56 None None] REQUEST_METHOD: `POST` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:04:40.924877 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996c9171-2c2c-4024-9de6-e74950648e56 None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:04:40.924993 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996c9171-2c2c-4024-9de6-e74950648e56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:04:40.990112 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.auth.core [None req-996c9171-2c2c-4024-9de6-e74950648e56 None None] MFA Rules not processed for user `8ba31ade43694cf8bf28f7528a9ea179`. Rule list: `[]` (Enabled: `True`). {{(pid=81533) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 11:04:40.991838 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-996c9171-2c2c-4024-9de6-e74950648e56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:04:41.000300 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:04:41.091809 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 570/1137] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Oct 13 11:04:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 11:04:41.375893 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3c7411-14dc-4465-b749-0bbeba363244 None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:04:41.377455 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-9d3c7411-14dc-4465-b749-0bbeba363244 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:04:41.481346 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3c7411-14dc-4465-b749-0bbeba363244 None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:04:41.535282 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:04:41.554181 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ead38b-4502-443d-824a-87ee992137ef service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d31effc2bc44d698b5adb5254263dc5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '112613528384453abe7506465609fbd8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:04:41.554783 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ead38b-4502-443d-824a-87ee992137ef service neutron] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:04:41.555058 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ead38b-4502-443d-824a-87ee992137ef service neutron] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:04:41.555325 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ead38b-4502-443d-824a-87ee992137ef service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:04:41.556886 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-d8ead38b-4502-443d-824a-87ee992137ef service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:04:41.668148 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ead38b-4502-443d-824a-87ee992137ef service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:04:41.669614 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ead38b-4502-443d-824a-87ee992137ef service neutron] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:04:41.688315 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 568/1138] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Oct 13 11:04:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 13 11:04:43.897839 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92711b0e-e822-410f-b24e-855a9605e97e None None] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:04:43.898456 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92711b0e-e822-410f-b24e-855a9605e97e None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:04:43.898619 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92711b0e-e822-410f-b24e-855a9605e97e None None] PATH_INFO: `/` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:04:43.899973 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 571/1139] 127.0.0.1 () {54 vars in 917 bytes} [Thu Oct 13 11:04:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 11:04:43.905219 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c88975-ebfb-437a-bb04-ee44e981254c None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:04:43.905668 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c88975-ebfb-437a-bb04-ee44e981254c None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:04:43.905798 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c88975-ebfb-437a-bb04-ee44e981254c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:04:43.971466 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-e4c88975-ebfb-437a-bb04-ee44e981254c None None] MFA Rules not processed for user `8ba31ade43694cf8bf28f7528a9ea179`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 11:04:43.972662 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-e4c88975-ebfb-437a-bb04-ee44e981254c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:04:44.011138 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:04:44.069520 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 569/1140] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Oct 13 11:04:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 13 11:04:44.353370 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92711b0e-e822-410f-b24e-855a9605e97e None None] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:04:44.354905 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-92711b0e-e822-410f-b24e-855a9605e97e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:04:44.458165 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92711b0e-e822-410f-b24e-855a9605e97e None None] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:04:44.495375 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:04:44.532255 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aaea557-3c2d-4f00-9109-36c6e54d1ef0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d31effc2bc44d698b5adb5254263dc5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '112613528384453abe7506465609fbd8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:04:44.532853 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aaea557-3c2d-4f00-9109-36c6e54d1ef0 service neutron] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:04:44.533158 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aaea557-3c2d-4f00-9109-36c6e54d1ef0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:04:44.533433 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aaea557-3c2d-4f00-9109-36c6e54d1ef0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:04:44.535004 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-4aaea557-3c2d-4f00-9109-36c6e54d1ef0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:04:44.641777 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aaea557-3c2d-4f00-9109-36c6e54d1ef0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:04:44.643116 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aaea557-3c2d-4f00-9109-36c6e54d1ef0 service neutron] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:04:44.661488 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 572/1141] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Oct 13 11:04:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 13 11:04:46.827805 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98dd37c-a349-461d-8c16-c55dcd35598c None None] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:04:46.828363 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98dd37c-a349-461d-8c16-c55dcd35598c None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:04:46.828363 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98dd37c-a349-461d-8c16-c55dcd35598c None None] PATH_INFO: `/` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:04:46.829729 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 570/1142] 127.0.0.1 () {54 vars in 917 bytes} [Thu Oct 13 11:04:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 11:04:46.835010 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c46c352-11b7-4f01-80d5-db81475baf0f None None] REQUEST_METHOD: `POST` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:04:46.835421 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c46c352-11b7-4f01-80d5-db81475baf0f None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:04:46.835706 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c46c352-11b7-4f01-80d5-db81475baf0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:04:46.906693 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.auth.core [None req-0c46c352-11b7-4f01-80d5-db81475baf0f None None] MFA Rules not processed for user `8ba31ade43694cf8bf28f7528a9ea179`. Rule list: `[]` (Enabled: `True`). {{(pid=81533) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 11:04:46.907905 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-0c46c352-11b7-4f01-80d5-db81475baf0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:04:46.930057 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:04:47.014143 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 573/1143] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Oct 13 11:04:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 11:04:47.372404 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98dd37c-a349-461d-8c16-c55dcd35598c None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:04:47.374694 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-b98dd37c-a349-461d-8c16-c55dcd35598c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:04:47.487191 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98dd37c-a349-461d-8c16-c55dcd35598c None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:04:47.561178 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:04:47.572682 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b5557d-96d6-4b5a-860d-135cf358009f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d31effc2bc44d698b5adb5254263dc5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '112613528384453abe7506465609fbd8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:04:47.573688 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b5557d-96d6-4b5a-860d-135cf358009f service neutron] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:04:47.574147 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b5557d-96d6-4b5a-860d-135cf358009f service neutron] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:04:47.574432 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b5557d-96d6-4b5a-860d-135cf358009f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:04:47.576065 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-c8b5557d-96d6-4b5a-860d-135cf358009f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:04:47.694758 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b5557d-96d6-4b5a-860d-135cf358009f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:04:47.696602 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b5557d-96d6-4b5a-860d-135cf358009f service neutron] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:04:47.715653 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 571/1144] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Oct 13 11:04:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 13 11:04:49.902308 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b830358c-409e-4dcc-aacd-2f567d5898b0 None None] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:04:49.902870 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b830358c-409e-4dcc-aacd-2f567d5898b0 None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:04:49.902870 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b830358c-409e-4dcc-aacd-2f567d5898b0 None None] PATH_INFO: `/` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:04:49.904249 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 574/1145] 127.0.0.1 () {54 vars in 917 bytes} [Thu Oct 13 11:04:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 11:04:49.909637 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2dc5068-79c1-4bbb-8791-aa13edd629da None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:04:49.910040 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2dc5068-79c1-4bbb-8791-aa13edd629da None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:04:49.910194 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2dc5068-79c1-4bbb-8791-aa13edd629da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:04:49.977807 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-c2dc5068-79c1-4bbb-8791-aa13edd629da None None] MFA Rules not processed for user `8ba31ade43694cf8bf28f7528a9ea179`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 11:04:49.979046 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-c2dc5068-79c1-4bbb-8791-aa13edd629da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:04:50.027710 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:04:50.076495 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 572/1146] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Oct 13 11:04:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 11:04:50.358302 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b830358c-409e-4dcc-aacd-2f567d5898b0 None None] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:04:50.359919 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-b830358c-409e-4dcc-aacd-2f567d5898b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:04:50.465666 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b830358c-409e-4dcc-aacd-2f567d5898b0 None None] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:04:50.514908 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:04:50.540628 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83e1b0d-6e08-41e3-97af-2c210f736a9c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d31effc2bc44d698b5adb5254263dc5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '112613528384453abe7506465609fbd8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:04:50.541256 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83e1b0d-6e08-41e3-97af-2c210f736a9c service neutron] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:04:50.541532 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83e1b0d-6e08-41e3-97af-2c210f736a9c service neutron] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:04:50.541802 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83e1b0d-6e08-41e3-97af-2c210f736a9c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:04:50.543375 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-c83e1b0d-6e08-41e3-97af-2c210f736a9c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:04:50.650216 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83e1b0d-6e08-41e3-97af-2c210f736a9c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:04:50.651587 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83e1b0d-6e08-41e3-97af-2c210f736a9c service neutron] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:04:50.669608 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 575/1147] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Oct 13 11:04:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 13 11:05:00.075100 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=22 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:05:00.667444 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=66 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:05:10.723454 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512a1eed-5802-4496-a58a-d84d001fc8a5 None None] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:05:10.724024 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512a1eed-5802-4496-a58a-d84d001fc8a5 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:05:10.724024 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512a1eed-5802-4496-a58a-d84d001fc8a5 None None] PATH_INFO: `/` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:05:10.726098 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 573/1148] 10.222.0.18 () {54 vars in 927 bytes} [Thu Oct 13 11:05:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 11:05:10.731565 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc9acbb-886a-43a3-be9b-8bd50c7987f7 None None] REQUEST_METHOD: `POST` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:05:10.731974 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc9acbb-886a-43a3-be9b-8bd50c7987f7 None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:05:10.732119 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc9acbb-886a-43a3-be9b-8bd50c7987f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:05:10.799764 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.auth.core [None req-6cc9acbb-886a-43a3-be9b-8bd50c7987f7 None None] MFA Rules not processed for user `8ba31ade43694cf8bf28f7528a9ea179`. Rule list: `[]` (Enabled: `True`). {{(pid=81533) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 11:05:10.800953 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-6cc9acbb-886a-43a3-be9b-8bd50c7987f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:05:10.896485 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 576/1149] 10.222.0.18 () {58 vars in 1024 bytes} [Thu Oct 13 11:05:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 11:05:11.196544 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302f5dac-c73d-4641-a96e-80d9bee7c42b None None] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:05:11.196835 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302f5dac-c73d-4641-a96e-80d9bee7c42b None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:05:11.197155 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302f5dac-c73d-4641-a96e-80d9bee7c42b None None] PATH_INFO: `/` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:05:11.198499 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 574/1150] 10.222.0.18 () {54 vars in 962 bytes} [Thu Oct 13 11:05:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 11:05:11.203468 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19d6203-0f3d-453b-82db-59977921eb0b None None] REQUEST_METHOD: `POST` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:05:11.203754 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19d6203-0f3d-453b-82db-59977921eb0b None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:05:11.204029 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19d6203-0f3d-453b-82db-59977921eb0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:05:11.279727 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.auth.core [None req-b19d6203-0f3d-453b-82db-59977921eb0b None None] MFA Rules not processed for user `85a35c31fd1340f79ac67a10b4963b44`. Rule list: `[]` (Enabled: `True`). {{(pid=81533) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 11:05:11.280853 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-b19d6203-0f3d-453b-82db-59977921eb0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:05:11.301616 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:05:11.357130 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 577/1151] 10.222.0.18 () {58 vars in 1059 bytes} [Thu Oct 13 11:05:11 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 11:05:11.364811 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302f5dac-c73d-4641-a96e-80d9bee7c42b None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:05:11.366347 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-302f5dac-c73d-4641-a96e-80d9bee7c42b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:05:11.469362 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302f5dac-c73d-4641-a96e-80d9bee7c42b None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:05:11.542804 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6250c08-b89a-452d-a2e8-c7bbd78d9cb3 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85a35c31fd1340f79ac67a10b4963b44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '112613528384453abe7506465609fbd8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:05:11.543328 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6250c08-b89a-452d-a2e8-c7bbd78d9cb3 service glance] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:05:11.543609 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6250c08-b89a-452d-a2e8-c7bbd78d9cb3 service glance] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:05:11.543878 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6250c08-b89a-452d-a2e8-c7bbd78d9cb3 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:05:11.545488 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-b6250c08-b89a-452d-a2e8-c7bbd78d9cb3 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:05:11.599310 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:05:11.655802 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6250c08-b89a-452d-a2e8-c7bbd78d9cb3 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:05:11.657310 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6250c08-b89a-452d-a2e8-c7bbd78d9cb3 service glance] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:05:11.675363 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 575/1152] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Oct 13 11:05:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 13 11:05:13.935205 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef51062-2108-45db-b880-1cb4bd1a0210 None None] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:05:13.935762 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef51062-2108-45db-b880-1cb4bd1a0210 None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:05:13.935762 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef51062-2108-45db-b880-1cb4bd1a0210 None None] PATH_INFO: `/` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:05:13.937110 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 578/1153] 10.222.0.18 () {54 vars in 927 bytes} [Thu Oct 13 11:05:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 11:05:13.942335 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a90144-f84b-4e06-9ecf-32f1fa10601f None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:05:13.942788 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a90144-f84b-4e06-9ecf-32f1fa10601f None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:05:13.942898 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a90144-f84b-4e06-9ecf-32f1fa10601f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:05:14.009054 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-50a90144-f84b-4e06-9ecf-32f1fa10601f None None] MFA Rules not processed for user `8ba31ade43694cf8bf28f7528a9ea179`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 11:05:14.010191 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-50a90144-f84b-4e06-9ecf-32f1fa10601f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:05:14.106419 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 576/1154] 10.222.0.18 () {58 vars in 1024 bytes} [Thu Oct 13 11:05:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 11:05:14.383903 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef51062-2108-45db-b880-1cb4bd1a0210 None None] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:05:14.385461 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-eef51062-2108-45db-b880-1cb4bd1a0210 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:05:14.511898 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef51062-2108-45db-b880-1cb4bd1a0210 None None] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:05:14.560914 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:05:14.606066 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67634e8c-0bb5-4d01-a1ad-e589a9858739 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ce4ee85562d450a9dc2f16f581130d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:05:14.606586 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67634e8c-0bb5-4d01-a1ad-e589a9858739 admin admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:05:14.606859 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67634e8c-0bb5-4d01-a1ad-e589a9858739 admin admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:05:14.607125 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67634e8c-0bb5-4d01-a1ad-e589a9858739 admin admin] PATH_INFO: `/v3/projects` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:05:14.607751 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67634e8c-0bb5-4d01-a1ad-e589a9858739 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:05:14.608846 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: WARNING py.warnings [None req-67634e8c-0bb5-4d01-a1ad-e589a9858739 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 13 11:05:14.608846 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: warnings.warn(msg) Oct 13 11:05:14.608846 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: Oct 13 11:05:14.610193 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67634e8c-0bb5-4d01-a1ad-e589a9858739 admin admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:05:14.628697 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 579/1155] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Oct 13 11:05:14 2022] GET /identity/v3/projects => generated 2553 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 13 11:05:16.801888 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab6cc4f-0c8e-46f3-be64-8033378d9b6e None None] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:05:16.803027 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab6cc4f-0c8e-46f3-be64-8033378d9b6e None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:05:16.803027 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab6cc4f-0c8e-46f3-be64-8033378d9b6e None None] PATH_INFO: `/` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:05:16.804322 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 577/1156] 10.222.0.18 () {54 vars in 927 bytes} [Thu Oct 13 11:05:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 11:05:16.809599 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da71bea-13fd-4fdf-a174-a467dfe1c9ef None None] REQUEST_METHOD: `POST` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:05:16.810025 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da71bea-13fd-4fdf-a174-a467dfe1c9ef None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:05:16.810124 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da71bea-13fd-4fdf-a174-a467dfe1c9ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:05:16.875678 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.auth.core [None req-5da71bea-13fd-4fdf-a174-a467dfe1c9ef None None] MFA Rules not processed for user `8ba31ade43694cf8bf28f7528a9ea179`. Rule list: `[]` (Enabled: `True`). {{(pid=81533) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 11:05:16.876876 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-5da71bea-13fd-4fdf-a174-a467dfe1c9ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:05:16.971260 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 580/1157] 10.222.0.18 () {58 vars in 1024 bytes} [Thu Oct 13 11:05:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 11:05:17.265906 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab6cc4f-0c8e-46f3-be64-8033378d9b6e None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:05:17.267457 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-dab6cc4f-0c8e-46f3-be64-8033378d9b6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:05:17.278180 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:05:17.412861 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab6cc4f-0c8e-46f3-be64-8033378d9b6e None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:05:17.492172 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:05:17.524845 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84bb9ed3-eb69-4689-9b1b-f7c146344fab service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc5b13f97c0e4a31940b5b73a916af29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '112613528384453abe7506465609fbd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:05:17.525409 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bb9ed3-eb69-4689-9b1b-f7c146344fab service nova] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:05:17.525686 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bb9ed3-eb69-4689-9b1b-f7c146344fab service nova] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:05:17.525954 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bb9ed3-eb69-4689-9b1b-f7c146344fab service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:05:17.527531 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-84bb9ed3-eb69-4689-9b1b-f7c146344fab service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:05:17.615206 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84bb9ed3-eb69-4689-9b1b-f7c146344fab service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:05:17.616819 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84bb9ed3-eb69-4689-9b1b-f7c146344fab service nova] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:05:17.635318 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 578/1158] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Oct 13 11:05:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 13 11:05:19.977474 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb3bb9e-5338-44a0-ba41-953dab08680f None None] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:05:19.978039 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb3bb9e-5338-44a0-ba41-953dab08680f None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:05:19.978039 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb3bb9e-5338-44a0-ba41-953dab08680f None None] PATH_INFO: `/` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:05:19.979522 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 581/1159] 10.222.0.18 () {54 vars in 927 bytes} [Thu Oct 13 11:05:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 13 11:05:19.984750 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b9ce19-b6e9-4d19-aa1b-0156696345d3 None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:05:19.985229 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b9ce19-b6e9-4d19-aa1b-0156696345d3 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:05:19.985340 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b9ce19-b6e9-4d19-aa1b-0156696345d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:05:20.060340 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-58b9ce19-b6e9-4d19-aa1b-0156696345d3 None None] MFA Rules not processed for user `8ba31ade43694cf8bf28f7528a9ea179`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 11:05:20.061582 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-58b9ce19-b6e9-4d19-aa1b-0156696345d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:05:20.109354 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:05:20.165045 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 579/1160] 10.222.0.18 () {58 vars in 1024 bytes} [Thu Oct 13 11:05:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 11:05:20.458708 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb3bb9e-5338-44a0-ba41-953dab08680f None None] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:05:20.460585 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-7bb3bb9e-5338-44a0-ba41-953dab08680f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:05:20.485081 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:05:20.566957 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb3bb9e-5338-44a0-ba41-953dab08680f None None] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:05:20.639140 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81fb956e-542f-4636-ad83-8c46bfbd4233 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d31effc2bc44d698b5adb5254263dc5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '112613528384453abe7506465609fbd8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:05:20.639665 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fb956e-542f-4636-ad83-8c46bfbd4233 service neutron] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:05:20.639941 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fb956e-542f-4636-ad83-8c46bfbd4233 service neutron] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:05:20.640212 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fb956e-542f-4636-ad83-8c46bfbd4233 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:05:20.642060 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-81fb956e-542f-4636-ad83-8c46bfbd4233 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:05:20.715380 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:05:20.751263 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81fb956e-542f-4636-ad83-8c46bfbd4233 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:05:20.752699 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81fb956e-542f-4636-ad83-8c46bfbd4233 service neutron] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:05:20.770594 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 582/1161] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Oct 13 11:05:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 13 11:05:22.966785 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02cb6e4-f819-43fc-a9ac-bc5eb2e0734d None None] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:05:22.967475 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02cb6e4-f819-43fc-a9ac-bc5eb2e0734d None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:05:22.967475 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02cb6e4-f819-43fc-a9ac-bc5eb2e0734d None None] PATH_INFO: `/` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:05:22.968670 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 580/1162] 10.222.0.18 () {54 vars in 927 bytes} [Thu Oct 13 11:05:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 11:05:22.974519 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed66647f-a547-4418-9f14-80d7dd96f763 None None] REQUEST_METHOD: `POST` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:05:22.975031 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed66647f-a547-4418-9f14-80d7dd96f763 None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:05:22.975404 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed66647f-a547-4418-9f14-80d7dd96f763 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:05:23.042169 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.auth.core [None req-ed66647f-a547-4418-9f14-80d7dd96f763 None None] MFA Rules not processed for user `8ba31ade43694cf8bf28f7528a9ea179`. Rule list: `[]` (Enabled: `True`). {{(pid=81533) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 11:05:23.043377 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-ed66647f-a547-4418-9f14-80d7dd96f763 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:05:23.137949 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 583/1163] 10.222.0.18 () {58 vars in 1024 bytes} [Thu Oct 13 11:05:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 13 11:05:23.427610 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02cb6e4-f819-43fc-a9ac-bc5eb2e0734d None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:05:23.429166 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-e02cb6e4-f819-43fc-a9ac-bc5eb2e0734d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:05:23.533647 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02cb6e4-f819-43fc-a9ac-bc5eb2e0734d None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:05:23.604206 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:05:23.605731 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a95df22-1c40-4d8a-a729-64a8da6dd7aa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d31effc2bc44d698b5adb5254263dc5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '112613528384453abe7506465609fbd8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:05:23.606321 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a95df22-1c40-4d8a-a729-64a8da6dd7aa service neutron] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:05:23.606786 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a95df22-1c40-4d8a-a729-64a8da6dd7aa service neutron] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:05:23.607219 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a95df22-1c40-4d8a-a729-64a8da6dd7aa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:05:23.609143 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-5a95df22-1c40-4d8a-a729-64a8da6dd7aa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:05:23.718867 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a95df22-1c40-4d8a-a729-64a8da6dd7aa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:05:23.720207 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a95df22-1c40-4d8a-a729-64a8da6dd7aa service neutron] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:05:23.738158 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 581/1164] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Oct 13 11:05:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 13 11:05:26.028477 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bd1482-b3a9-4f63-946f-afbb84e11d7b None None] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:05:26.029031 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bd1482-b3a9-4f63-946f-afbb84e11d7b None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:05:26.029031 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bd1482-b3a9-4f63-946f-afbb84e11d7b None None] PATH_INFO: `/` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:05:26.030359 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 584/1165] 10.222.0.18 () {54 vars in 927 bytes} [Thu Oct 13 11:05:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 11:05:26.035808 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890b487f-d0f8-4c22-8b0d-095b17ec8e87 None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:05:26.036268 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890b487f-d0f8-4c22-8b0d-095b17ec8e87 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:05:26.036490 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890b487f-d0f8-4c22-8b0d-095b17ec8e87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:05:26.102528 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-890b487f-d0f8-4c22-8b0d-095b17ec8e87 None None] MFA Rules not processed for user `8ba31ade43694cf8bf28f7528a9ea179`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 11:05:26.103712 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-890b487f-d0f8-4c22-8b0d-095b17ec8e87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:05:26.155617 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:05:26.200416 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 582/1166] 10.222.0.18 () {58 vars in 1024 bytes} [Thu Oct 13 11:05:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 11:05:26.496024 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05bd1482-b3a9-4f63-946f-afbb84e11d7b None None] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:05:26.497610 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-05bd1482-b3a9-4f63-946f-afbb84e11d7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:05:26.542314 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:05:26.611416 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05bd1482-b3a9-4f63-946f-afbb84e11d7b None None] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:05:26.686465 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea6717e-a651-490f-8d8a-3ab346460310 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d31effc2bc44d698b5adb5254263dc5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '112613528384453abe7506465609fbd8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:05:26.687172 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea6717e-a651-490f-8d8a-3ab346460310 service neutron] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:05:26.687458 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea6717e-a651-490f-8d8a-3ab346460310 service neutron] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:05:26.687727 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea6717e-a651-490f-8d8a-3ab346460310 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:05:26.689343 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-fea6717e-a651-490f-8d8a-3ab346460310 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:05:26.768541 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:05:26.799462 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea6717e-a651-490f-8d8a-3ab346460310 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:05:26.800887 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea6717e-a651-490f-8d8a-3ab346460310 service neutron] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:05:26.819786 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 585/1167] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Oct 13 11:05:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 13 11:05:29.219891 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b1dec7-5f9f-4271-8541-ca54bb4c5b0c None None] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:05:29.220454 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b1dec7-5f9f-4271-8541-ca54bb4c5b0c None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:05:29.220454 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b1dec7-5f9f-4271-8541-ca54bb4c5b0c None None] PATH_INFO: `/` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:05:29.221849 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 583/1168] 10.222.0.18 () {54 vars in 927 bytes} [Thu Oct 13 11:05:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 11:05:29.227944 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7f7f31-1156-4dbb-b3a8-02b85dbfd937 None None] REQUEST_METHOD: `POST` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:05:29.228338 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7f7f31-1156-4dbb-b3a8-02b85dbfd937 None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:05:29.228501 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7f7f31-1156-4dbb-b3a8-02b85dbfd937 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:05:29.294204 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.auth.core [None req-bd7f7f31-1156-4dbb-b3a8-02b85dbfd937 None None] MFA Rules not processed for user `8ba31ade43694cf8bf28f7528a9ea179`. Rule list: `[]` (Enabled: `True`). {{(pid=81533) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 11:05:29.295403 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-bd7f7f31-1156-4dbb-b3a8-02b85dbfd937 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:05:29.390140 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 586/1169] 10.222.0.18 () {58 vars in 1024 bytes} [Thu Oct 13 11:05:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 11:05:29.682492 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b1dec7-5f9f-4271-8541-ca54bb4c5b0c None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:05:29.684025 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-d9b1dec7-5f9f-4271-8541-ca54bb4c5b0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:05:29.788861 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b1dec7-5f9f-4271-8541-ca54bb4c5b0c None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:05:29.861054 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef98154-a4f4-4075-9890-1733d79e571f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d31effc2bc44d698b5adb5254263dc5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '112613528384453abe7506465609fbd8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:05:29.861647 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef98154-a4f4-4075-9890-1733d79e571f service neutron] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:05:29.861921 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef98154-a4f4-4075-9890-1733d79e571f service neutron] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:05:29.862187 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef98154-a4f4-4075-9890-1733d79e571f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:05:29.863758 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-8ef98154-a4f4-4075-9890-1733d79e571f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:05:29.873121 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:05:29.972447 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef98154-a4f4-4075-9890-1733d79e571f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:05:29.973857 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef98154-a4f4-4075-9890-1733d79e571f service neutron] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:05:29.991880 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 584/1170] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Oct 13 11:05:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 13 11:05:39.388599 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=82 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:05:39.989286 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=50 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:06:42.913808 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71868eec-ed2b-4f91-96fd-952092373015 None None] REQUEST_METHOD: `POST` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:06:42.914400 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71868eec-ed2b-4f91-96fd-952092373015 None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:06:42.914400 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71868eec-ed2b-4f91-96fd-952092373015 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:06:42.993464 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.auth.core [None req-71868eec-ed2b-4f91-96fd-952092373015 None None] MFA Rules not processed for user `8ba31ade43694cf8bf28f7528a9ea179`. Rule list: `[]` (Enabled: `True`). {{(pid=81533) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 11:06:42.995435 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-71868eec-ed2b-4f91-96fd-952092373015 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:06:43.093723 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 587/1171] 10.222.0.18 () {58 vars in 958 bytes} [Thu Oct 13 11:06:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 11:06:43.101858 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885ea18c-fcf7-4992-92a6-c13a09552e35 None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:06:43.102353 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885ea18c-fcf7-4992-92a6-c13a09552e35 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:06:43.102450 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885ea18c-fcf7-4992-92a6-c13a09552e35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:06:43.178011 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-885ea18c-fcf7-4992-92a6-c13a09552e35 None None] MFA Rules not processed for user `8ba31ade43694cf8bf28f7528a9ea179`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 11:06:43.179224 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-885ea18c-fcf7-4992-92a6-c13a09552e35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:06:43.274332 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 585/1172] 10.222.0.18 () {58 vars in 958 bytes} [Thu Oct 13 11:06:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 11:06:43.278872 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71868eec-ed2b-4f91-96fd-952092373015 None None] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:06:43.280051 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-71868eec-ed2b-4f91-96fd-952092373015 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:06:43.291115 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71868eec-ed2b-4f91-96fd-952092373015 None None] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:06:43.351321 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:06:43.385353 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdae0d63-8600-421e-8ffc-3915ae8db780 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ce4ee85562d450a9dc2f16f581130d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:06:43.385944 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdae0d63-8600-421e-8ffc-3915ae8db780 admin admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:06:43.386216 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdae0d63-8600-421e-8ffc-3915ae8db780 admin admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:06:43.386482 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdae0d63-8600-421e-8ffc-3915ae8db780 admin admin] PATH_INFO: `/v3/domains` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:06:43.387111 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdae0d63-8600-421e-8ffc-3915ae8db780 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81533) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 13 11:06:43.387403 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdae0d63-8600-421e-8ffc-3915ae8db780 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:06:43.388410 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: WARNING py.warnings [None req-cdae0d63-8600-421e-8ffc-3915ae8db780 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 13 11:06:43.388410 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: warnings.warn(msg) Oct 13 11:06:43.388410 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: Oct 13 11:06:43.389301 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdae0d63-8600-421e-8ffc-3915ae8db780 admin admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:06:43.400470 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 588/1173] 10.222.0.18 () {58 vars in 1153 bytes} [Thu Oct 13 11:06:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 13 11:06:43.409990 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885ea18c-fcf7-4992-92a6-c13a09552e35 None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:06:43.419208 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885ea18c-fcf7-4992-92a6-c13a09552e35 None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:06:43.478936 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:06:43.511993 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321938fc-de87-4c02-a765-ed4ad823787a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ce4ee85562d450a9dc2f16f581130d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:06:43.512578 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321938fc-de87-4c02-a765-ed4ad823787a admin admin] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:06:43.512851 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321938fc-de87-4c02-a765-ed4ad823787a admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:06:43.513150 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321938fc-de87-4c02-a765-ed4ad823787a admin admin] PATH_INFO: `/v3/projects` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:06:43.513768 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321938fc-de87-4c02-a765-ed4ad823787a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:06:43.514756 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: WARNING py.warnings [None req-321938fc-de87-4c02-a765-ed4ad823787a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 13 11:06:43.514756 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: warnings.warn(msg) Oct 13 11:06:43.514756 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: Oct 13 11:06:43.515969 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321938fc-de87-4c02-a765-ed4ad823787a admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:06:43.570547 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 586/1174] 10.222.0.18 () {60 vars in 1153 bytes} [Thu Oct 13 11:06:43 2022] POST /identity/v3/projects => generated 379 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 13 11:06:43.574700 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdae0d63-8600-421e-8ffc-3915ae8db780 admin admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:06:43.576223 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-cdae0d63-8600-421e-8ffc-3915ae8db780 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:06:43.609660 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdae0d63-8600-421e-8ffc-3915ae8db780 admin admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:06:43.701966 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9e50e8-54e9-4422-a440-fcf2028039e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ce4ee85562d450a9dc2f16f581130d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:06:43.702557 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9e50e8-54e9-4422-a440-fcf2028039e9 admin admin] REQUEST_METHOD: `POST` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:06:43.702827 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9e50e8-54e9-4422-a440-fcf2028039e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:06:43.703090 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9e50e8-54e9-4422-a440-fcf2028039e9 admin admin] PATH_INFO: `/v3/users` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:06:43.703718 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f9e50e8-54e9-4422-a440-fcf2028039e9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:06:43.704706 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: WARNING py.warnings [None req-7f9e50e8-54e9-4422-a440-fcf2028039e9 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 13 11:06:43.704706 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: warnings.warn(msg) Oct 13 11:06:43.704706 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: Oct 13 11:06:43.706062 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f9e50e8-54e9-4422-a440-fcf2028039e9 admin admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:06:43.748951 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 589/1175] 10.222.0.18 () {60 vars in 1144 bytes} [Thu Oct 13 11:06:43 2022] POST /identity/v3/users => generated 290 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 13 11:06:43.753146 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321938fc-de87-4c02-a765-ed4ad823787a admin admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:06:43.754624 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-321938fc-de87-4c02-a765-ed4ad823787a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:06:43.815035 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321938fc-de87-4c02-a765-ed4ad823787a admin admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:06:43.896728 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:06:43.907140 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7ffdf9-2a79-43cd-81d1-8e5de6242418 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ce4ee85562d450a9dc2f16f581130d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:06:43.907728 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7ffdf9-2a79-43cd-81d1-8e5de6242418 admin admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:06:43.908002 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7ffdf9-2a79-43cd-81d1-8e5de6242418 admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:06:43.908269 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7ffdf9-2a79-43cd-81d1-8e5de6242418 admin admin] PATH_INFO: `/v3/roles` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:06:43.908941 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7ffdf9-2a79-43cd-81d1-8e5de6242418 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:06:43.910567 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7ffdf9-2a79-43cd-81d1-8e5de6242418 admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:06:43.922687 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 587/1176] 10.222.0.18 () {58 vars in 1122 bytes} [Thu Oct 13 11:06:43 2022] GET /identity/v3/roles => generated 1420 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 13 11:06:43.927327 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9e50e8-54e9-4422-a440-fcf2028039e9 admin admin] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:06:43.928902 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-7f9e50e8-54e9-4422-a440-fcf2028039e9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:06:43.940777 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9e50e8-54e9-4422-a440-fcf2028039e9 admin admin] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:06:43.965775 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:06:44.035810 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d91cd0d-1a91-4819-9968-bdf14edee224 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ce4ee85562d450a9dc2f16f581130d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:06:44.036408 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d91cd0d-1a91-4819-9968-bdf14edee224 admin admin] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:06:44.036709 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d91cd0d-1a91-4819-9968-bdf14edee224 admin admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:06:44.036973 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d91cd0d-1a91-4819-9968-bdf14edee224 admin admin] PATH_INFO: `/v3/roles` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:06:44.037635 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d91cd0d-1a91-4819-9968-bdf14edee224 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:06:44.039215 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d91cd0d-1a91-4819-9968-bdf14edee224 admin admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:06:44.051817 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 590/1177] 10.222.0.18 () {58 vars in 1122 bytes} [Thu Oct 13 11:06:43 2022] GET /identity/v3/roles => generated 1420 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 13 11:06:44.056069 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7ffdf9-2a79-43cd-81d1-8e5de6242418 admin admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:06:44.057603 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-5f7ffdf9-2a79-43cd-81d1-8e5de6242418 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:06:44.091361 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7ffdf9-2a79-43cd-81d1-8e5de6242418 admin admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:06:44.182534 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d701aa6-6d16-4cac-9c9c-b7e8217d6390 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ce4ee85562d450a9dc2f16f581130d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:06:44.183174 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d701aa6-6d16-4cac-9c9c-b7e8217d6390 admin admin] REQUEST_METHOD: `PUT` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:06:44.183446 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d701aa6-6d16-4cac-9c9c-b7e8217d6390 admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:06:44.183710 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d701aa6-6d16-4cac-9c9c-b7e8217d6390 admin admin] PATH_INFO: `/v3/projects/e2caf3e242b643108306d20c7d69dcd2/users/df52b03eb6cf44018eeae45bdd0621f6/roles/a893cd4f751e445aab4dda1a832f24a1` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:06:44.206342 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d701aa6-6d16-4cac-9c9c-b7e8217d6390 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e2caf3e242b643108306d20c7d69dcd2, user_id=df52b03eb6cf44018eeae45bdd0621f6, role_id=a893cd4f751e445aab4dda1a832f24a1)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:06:44.208973 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d701aa6-6d16-4cac-9c9c-b7e8217d6390 admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:06:44.233834 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 588/1178] 10.222.0.18 () {60 vars in 1483 bytes} [Thu Oct 13 11:06:44 2022] PUT /identity/v3/projects/e2caf3e242b643108306d20c7d69dcd2/users/df52b03eb6cf44018eeae45bdd0621f6/roles/a893cd4f751e445aab4dda1a832f24a1 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 13 11:06:44.245290 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5342ef-340a-4fbf-94c4-60655e20fc2a None None] REQUEST_METHOD: `POST` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:06:44.245624 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5342ef-340a-4fbf-94c4-60655e20fc2a None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:06:44.245895 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5342ef-340a-4fbf-94c4-60655e20fc2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:06:44.303638 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.auth.core [None req-fc5342ef-340a-4fbf-94c4-60655e20fc2a None None] MFA Rules not processed for user `df52b03eb6cf44018eeae45bdd0621f6`. Rule list: `[]` (Enabled: `True`). {{(pid=81533) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 11:06:44.304838 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-fc5342ef-340a-4fbf-94c4-60655e20fc2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:06:44.380685 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 591/1179] 10.222.0.18 () {58 vars in 958 bytes} [Thu Oct 13 11:06:44 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 11:06:44.394364 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33c1732-50fb-42f4-b67c-6c21ca9ae718 None None] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:06:44.394905 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33c1732-50fb-42f4-b67c-6c21ca9ae718 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:06:44.395179 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33c1732-50fb-42f4-b67c-6c21ca9ae718 None None] PATH_INFO: `/` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:06:44.396498 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 589/1180] 10.222.0.18 () {54 vars in 963 bytes} [Thu Oct 13 11:06:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 11:06:44.401450 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79996631-c3c8-4497-986f-238f8616b891 None None] REQUEST_METHOD: `POST` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:06:44.401742 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79996631-c3c8-4497-986f-238f8616b891 None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:06:44.402026 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79996631-c3c8-4497-986f-238f8616b891 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:06:44.433312 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:06:44.478408 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.auth.core [None req-79996631-c3c8-4497-986f-238f8616b891 None None] MFA Rules not processed for user `5bd577557f564e148ebd1dcde1e8580b`. Rule list: `[]` (Enabled: `True`). {{(pid=81533) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 11:06:44.479607 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-79996631-c3c8-4497-986f-238f8616b891 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:06:44.553964 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 592/1181] 10.222.0.18 () {58 vars in 1060 bytes} [Thu Oct 13 11:06:44 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 11:06:44.561793 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33c1732-50fb-42f4-b67c-6c21ca9ae718 None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:06:44.563296 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-b33c1732-50fb-42f4-b67c-6c21ca9ae718 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:06:44.613989 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:06:44.668300 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33c1732-50fb-42f4-b67c-6c21ca9ae718 None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:06:44.740685 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09083115-e377-468b-8344-3a8064aef410 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5bd577557f564e148ebd1dcde1e8580b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '112613528384453abe7506465609fbd8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:06:44.741321 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09083115-e377-468b-8344-3a8064aef410 service cinder] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:06:44.741600 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09083115-e377-468b-8344-3a8064aef410 service cinder] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:06:44.741873 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09083115-e377-468b-8344-3a8064aef410 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:06:44.743441 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-09083115-e377-468b-8344-3a8064aef410 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:06:44.842025 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09083115-e377-468b-8344-3a8064aef410 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:06:44.843438 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09083115-e377-468b-8344-3a8064aef410 service cinder] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:06:44.846909 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:06:44.862251 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 590/1182] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Oct 13 11:06:44 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 13 11:06:44.908135 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2444e00-6b88-4a7c-9843-65096752a864 None None] REQUEST_METHOD: `GET` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:06:44.908463 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2444e00-6b88-4a7c-9843-65096752a864 None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:06:44.908752 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2444e00-6b88-4a7c-9843-65096752a864 None None] PATH_INFO: `/` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:06:44.910074 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 593/1183] 10.222.0.18 () {52 vars in 830 bytes} [Thu Oct 13 11:06:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 13 11:06:44.913651 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09083115-e377-468b-8344-3a8064aef410 service cinder] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:06:44.914866 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-09083115-e377-468b-8344-3a8064aef410 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:06:45.018211 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09083115-e377-468b-8344-3a8064aef410 service cinder] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:06:45.110715 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f62ca5c-b239-415f-8651-84aa90a6c965 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ce4ee85562d450a9dc2f16f581130d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:06:45.111329 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f62ca5c-b239-415f-8651-84aa90a6c965 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:06:45.112100 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f62ca5c-b239-415f-8651-84aa90a6c965 admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:06:45.112551 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f62ca5c-b239-415f-8651-84aa90a6c965 admin admin] PATH_INFO: `/v3/users/df52b03eb6cf44018eeae45bdd0621f6` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:06:45.124997 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f62ca5c-b239-415f-8651-84aa90a6c965 admin admin] RBAC: Authorizing `identity:delete_user(user_id=df52b03eb6cf44018eeae45bdd0621f6)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:06:45.126020 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: WARNING py.warnings [None req-4f62ca5c-b239-415f-8651-84aa90a6c965 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 13 11:06:45.126020 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: warnings.warn(msg) Oct 13 11:06:45.126020 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: Oct 13 11:06:45.127817 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f62ca5c-b239-415f-8651-84aa90a6c965 admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:06:45.137640 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:06:45.194025 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-4f62ca5c-b239-415f-8651-84aa90a6c965 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'df52b03eb6cf44018eeae45bdd0621f6'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:06:45.209975 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-4f62ca5c-b239-415f-8651-84aa90a6c965 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'df52b03eb6cf44018eeae45bdd0621f6'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:06:45.210443 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-4f62ca5c-b239-415f-8651-84aa90a6c965 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'df52b03eb6cf44018eeae45bdd0621f6'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:06:45.220640 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-4f62ca5c-b239-415f-8651-84aa90a6c965 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'df52b03eb6cf44018eeae45bdd0621f6'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:06:45.244223 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-4f62ca5c-b239-415f-8651-84aa90a6c965 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'df52b03eb6cf44018eeae45bdd0621f6'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:06:45.250186 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 591/1184] 10.222.0.18 () {58 vars in 1224 bytes} [Thu Oct 13 11:06:44 2022] DELETE /identity/v3/users/df52b03eb6cf44018eeae45bdd0621f6 => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 11:06:45.254642 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53198773-0d01-44b9-aff7-7ce700014bce None None] REQUEST_METHOD: `POST` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:06:45.255155 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53198773-0d01-44b9-aff7-7ce700014bce None None] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:06:45.255262 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53198773-0d01-44b9-aff7-7ce700014bce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:06:45.312127 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.auth.core [None req-53198773-0d01-44b9-aff7-7ce700014bce None None] MFA Rules not processed for user `8ba31ade43694cf8bf28f7528a9ea179`. Rule list: `[]` (Enabled: `True`). {{(pid=81533) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 13 11:06:45.313267 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-53198773-0d01-44b9-aff7-7ce700014bce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:06:45.386995 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=100 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:06:45.399617 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 594/1185] 10.222.0.18 () {58 vars in 958 bytes} [Thu Oct 13 11:06:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 13 11:06:45.410005 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f62ca5c-b239-415f-8651-84aa90a6c965 admin admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:06:45.411315 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-4f62ca5c-b239-415f-8651-84aa90a6c965 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:06:45.511335 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f62ca5c-b239-415f-8651-84aa90a6c965 admin admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:06:45.568367 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:06:45.588107 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270698fc-7a40-4455-acf2-ad00d908b85c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d31effc2bc44d698b5adb5254263dc5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '112613528384453abe7506465609fbd8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:06:45.588708 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270698fc-7a40-4455-acf2-ad00d908b85c service neutron] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:06:45.588985 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270698fc-7a40-4455-acf2-ad00d908b85c service neutron] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:06:45.589290 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270698fc-7a40-4455-acf2-ad00d908b85c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:06:45.590878 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-270698fc-7a40-4455-acf2-ad00d908b85c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:06:45.699758 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270698fc-7a40-4455-acf2-ad00d908b85c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:06:45.701211 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270698fc-7a40-4455-acf2-ad00d908b85c service neutron] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:06:45.719790 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 592/1186] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Oct 13 11:06:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 13 11:06:46.065440 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53198773-0d01-44b9-aff7-7ce700014bce None None] Authenticating user token {{(pid=81533) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 13 11:06:46.066671 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.fernet_utils [None req-53198773-0d01-44b9-aff7-7ce700014bce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81533) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 13 11:06:46.077782 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53198773-0d01-44b9-aff7-7ce700014bce None None] Validating token access rules against request {{(pid=81533) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 13 11:06:46.175819 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae8a1c2-ca9a-4ca9-8d1b-752ce1dee6a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba31ade43694cf8bf28f7528a9ea179', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ce4ee85562d450a9dc2f16f581130d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81533) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 13 11:06:46.176438 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae8a1c2-ca9a-4ca9-8d1b-752ce1dee6a1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 13 11:06:46.176711 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae8a1c2-ca9a-4ca9-8d1b-752ce1dee6a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 13 11:06:46.176978 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae8a1c2-ca9a-4ca9-8d1b-752ce1dee6a1 admin admin] PATH_INFO: `/v3/projects/e2caf3e242b643108306d20c7d69dcd2` {{(pid=81533) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 13 11:06:46.187268 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae8a1c2-ca9a-4ca9-8d1b-752ce1dee6a1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e2caf3e242b643108306d20c7d69dcd2)` {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 13 11:06:46.188281 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: WARNING py.warnings [None req-8ae8a1c2-ca9a-4ca9-8d1b-752ce1dee6a1 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 13 11:06:46.188281 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: warnings.warn(msg) Oct 13 11:06:46.188281 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: Oct 13 11:06:46.189515 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae8a1c2-ca9a-4ca9-8d1b-752ce1dee6a1 admin admin] RBAC: Authorization granted {{(pid=81533) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 13 11:06:46.246592 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.notifications [None req-8ae8a1c2-ca9a-4ca9-8d1b-752ce1dee6a1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e2caf3e242b643108306d20c7d69dcd2', 'request_id': 'req-8ae8a1c2-ca9a-4ca9-8d1b-752ce1dee6a1'} {{(pid=81533) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:06:46.252991 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.notifications [None req-8ae8a1c2-ca9a-4ca9-8d1b-752ce1dee6a1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e2caf3e242b643108306d20c7d69dcd2', 'request_id': 'req-8ae8a1c2-ca9a-4ca9-8d1b-752ce1dee6a1'} {{(pid=81533) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:06:46.265822 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.notifications [None req-8ae8a1c2-ca9a-4ca9-8d1b-752ce1dee6a1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e2caf3e242b643108306d20c7d69dcd2', 'request_id': 'req-8ae8a1c2-ca9a-4ca9-8d1b-752ce1dee6a1'} {{(pid=81533) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:06:46.292543 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.notifications [None req-8ae8a1c2-ca9a-4ca9-8d1b-752ce1dee6a1 admin admin] The token cache is being invalidate because project e2caf3e242b643108306d20c7d69dcd2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81533) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 13 11:06:46.292835 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.notifications [None req-8ae8a1c2-ca9a-4ca9-8d1b-752ce1dee6a1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81533) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:06:46.293331 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG keystone.notifications [None req-8ae8a1c2-ca9a-4ca9-8d1b-752ce1dee6a1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81533) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 13 11:06:46.294728 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: [pid: 81533|app: 0|req: 595/1187] 10.222.0.18 () {58 vars in 1233 bytes} [Thu Oct 13 11:06:46 2022] DELETE /identity/v3/projects/e2caf3e242b643108306d20c7d69dcd2 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 13 11:06:55.717554 dv-cinder-861001-1-iscsi devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=62 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 11:06:56.290532 dv-cinder-861001-1-iscsi devstack@keystone.service[81533]: DEBUG dbcounter [-] [81533] Writing DB stats keystone:SELECT=84,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}